Posts Tagged ‘imro’
Thursday, February 17th, 2011
MRA recently released version 1 of the MRA/IMRO Guide to the Top 16 Social Media Research Questions, a tool to help newcomers and vendors communicate with each other about this new datasource and method. Conversition was a key contributor to this document which is now available on the MRA website.
.
This blog is #16 in a series of 16, each one addressing Conversition’s viewpoint on one of the items in the guidelines. We welcome your questions and comments, and look forward to further discussions on this exciting new trend in the market research industry.
duboix from morguefile
.
What, if any, methods are used for determining the geography associated with the data?
.
Geography and demographics are a tricky situation for social media research. Unlike survey research where people provide their age, gender, and other personal information, very few people do so in the social media space. (When was the last time you saw someone tweet something like, “I’m a 28 year old female who has a Marketing Diploma and I love poptarts.”)
.
There certainly are methods of determining the geographical and demographic characteristics of people contributing to social media but they aren’t perfect.
- How about if you notice if the website is .ca or .uk or .au? We wish that method worked but the vast majority of social media is generated in .com websites which are visited from people all around the world. And, people don’t refrain from posting on websites just because they notice it’s reflecting a different country. The internet is a wonderfully global population.
- How about IP addresses? This is another option, but again, a less than perfect option. According to my IP address, I’m sitting in the USA right now. But, I’m pretty sure I’m not!
- What about the demos that people do share? Yes, people do share their demographic information. A very, very tiny % of people share one or two pieces of information but certainly nowhere near what researchers are used to, and certainly nowhere near what is required to create a valid generalization outside of those individual people.
Because of these reasons, Conversition uses a variety of methods for understanding the demographics of social media contributors.
.
Related links
MRA IMRO Guide #1: Advantages and Disadvantages of SMR
MRA IMRO Guide #2: Datasources of SMR
MRA IMRO Guide #3: Data Fusion and SMR
MRA IMRO Guide #4: Reliability of SMR
MRA IMRO Guide #5: Responsibilities of Social Media Data Users
MRA IMRO Guide #6: Social Media Research Skills
MRA IMRO Guide #7: Research Contributor Awareness
MRA IMRO Guide #8: Citing Reference
MRA IMRO Guide #9: Legal Issues
<
Comments Off
Category conversition | Tags: Tags: annie pettit, citation, citing, content analysis, conversition, focus groups, guide, guidelines, imro, lovestats, market research, marketresearch, mra, mrx, navigating, newmr, references, reliability, sentiment analysis, smr, social media analytics, social media marketing, social media monitor, social media monitoring, social media plan, social media research, social media strategy, surveys, tessie ting, tessietweets, text analysis, validity,
Social Networks : Technorati, Stumble it!, Digg, de.licio.us, Yahoo, reddit, Blogmarks, Google, Magnolia.
Tuesday, February 15th, 2011
MRA recently released version 1 of the MRA/IMRO Guide to the Top 16 Social Media Research Questions, a tool to help newcomers and vendors communicate with each other about this new datasource and method. Conversition was a key contributor to this document which is now available on the MRA website.
.
This blog is #15 in a series of 16, each one addressing Conversition’s viewpoint on one of the items in the guidelines. We welcome your questions and comments, and look forward to further discussions on this exciting new trend in the market research industry.
clarita from morguefile
If sentiment scoring is provided, what is the process for validating results?
.
We regularly validate both our sentiment analysis and our content analysis results.
.
Sentiment analysis is validated both at a project level (for example, just YOUR data) as well as at an overall level (a random sample across many different brands). Though there are more scientifically accurate methods (i.e., have fun reading Krippendorf!), we have chosen a simpler method because it is easily understood by both novice and experienced research users.
The two important features of our process are 1) the large sample size which ensures we do not receive spuriously high (or low) validation scores associated with a skewed selection of data points, and 2) the blinded nature of the manual scoring which ensures the researcher does not unconsciously create high validation scores.
Our process is as follows:
- Randomly select 1000 verbatims
- Manually score each verbatim as negative, neutral, or positive
- Align the automated scores to the manual scores
- Calculate the percentage of automated and manual scores that match
The process for validating constructs is similar.
- Randomly select 1000 verbatims from a specific construct
- Determine if it does or does not reflect the intended construct
- Calculate the percentage of verbatims that were correctly identified as reflecting the intended construct
At the end of each process, we then identify the weak points and adjust our systems to account for them. For instance, if we discover that “Charlie Brown has been erroneously coded under the color construct, that anomaly is corrected.
It takes a long time to validate data but if you’re going to do it, you might as well do it right.
.
.
Related links
MRA IMRO Guide #1: Advantages and Disadvantages of SMR
MRA IMRO Guide #2: Datasources of SMR
MRA IMRO Guide #3: Data Fusion and SMR
MRA IMRO Guide #4: Reliability of SMR
MRA IMRO Guide #5: Responsibilities of Social Media Data Users
MRA IMRO Guide #6: Social Media Research Skills
MRA IMRO Guide #7: Research Contributor Awareness
MRA IMRO Guide #8: Citing Reference
MRA IMRO Guide #9: Legal Issues
Comments Off
Category conversition | Tags: Tags: annie pettit, citation, citing, content analysis, conversition, focus groups, guide, guidelines, imro, lovestats, market research, marketresearch, mra, mrx, navigating, newmr, references, reliability, sentiment analysis, smr, social media analytics, social media marketing, social media monitoring, social media plan, social media research, social media strategy, surveys, tessie ting, tessietweets, text analysis, validity,
Social Networks : Technorati, Stumble it!, Digg, de.licio.us, Yahoo, reddit, Blogmarks, Google, Magnolia.
Saturday, February 12th, 2011
MRA recently released version 1 of the MRA/IMRO Guide to the Top 16 Social Media Research Questions, a tool to help newcomers and vendors communicate with each other about this new datasource and method. Conversition was a key contributor to this document which is now available on the MRA website.
.
This blog is #14 in a series of 16, each one addressing Conversition’s viewpoint on one of the items in the guidelines. We welcome your questions and comments, and look forward to further discussions on this exciting new trend in the market research industry.
Alvimann from morguefile
Does the company provide sentiment scoring?
Why yes we do!
Conversition has built a proprietary sentiment scoring system that features many advantages. We’re very proud of its accuracy, particularly in relation to its application in marketing research.
- We score more than 95% of data.
- We do not throw out verbatims that can’t be scored because it turns out they are true neutrals.
- We score verbatims on a continuous scale from extremely negative to extremely positive.
- We score grammatically correct and grammatically incorrect conversations.
- We score emoticons and slang.
- We use an automated system that lets us score millions of conversations every day.
- Our system is carefully designed to meet the specific needs of market researchers.
.
.
Related links
MRA IMRO Guide #1: Advantages and Disadvantages of SMR
MRA IMRO Guide #2: Datasources of SMR
MRA IMRO Guide #3: Data Fusion and SMR
MRA IMRO Guide #4: Reliability of SMR
MRA IMRO Guide #5: Responsibilities of Social Media Data Users
MRA IMRO Guide #6: Social Media Research Skills
MRA IMRO Guide #7: Research Contributor Awareness
MRA IMRO Guide #8: Citing Reference
MRA IMRO Guide #9: Legal Issues
Comments Off
Category conversition | Tags: Tags: annie pettit, citation, citing, conversition, guide, guidelines, imro, lovestats, market research, mra, mrx, navigating, references, reliability, smr, social media analytics, social media monitor, social media research, tessie ting, validity,
Social Networks : Technorati, Stumble it!, Digg, de.licio.us, Yahoo, reddit, Blogmarks, Google, Magnolia.
Thursday, February 10th, 2011
MRA recently released version 1 of the MRA/IMRO Guide to the Top 16 Social Media Research Questions, a tool to help newcomers and vendors communicate with each other about this new datasource and method. Conversition was a key contributor to this document which is now available on the MRA website.
.
This blog is #13 in a series of 16, each one addressing Conversition’s viewpoint on one of the items in the guidelines. We welcome your questions and comments, and look forward to further discussions on this exciting new trend in the market research industry.
manicmorff from morguefile
What data quality processes are implemented in each stage of the SMR?
Ah, we love data quality! You need a sharp eye to see all of the details that we focus on in our regular data quality processes.
Once data has been collected, we apply rigorous techniques to identify and remove many different types of spam. Keyword loading and unmoderated boards are the worst of the offendors but we vigorously seek them out. That’s how we know that British Petroleum data isn’t Blood Pressure or Basis Point data.
We also apply apply rigorous processes to both our sentiment scoring and content analysis. That’s how we know that Charlie Brown isn’t a color and that ‘what a crock’ isn’t dishes. That’s how we know that “the bomb” is a good thing to say but “ftl” isn’t.
It’s not sufficient for us to use a one method fits all system. We know that doesn’t work. So we have a one method fits all process and hundreds of individualized methods, a unique one for every client. Because we know that an average level of data quality isn’t good enough. You need data quality specific to your job.
Quality is job 1. We believe it and practice it.
.
.
Related links
MRA IMRO Guide #1: Advantages and Disadvantages of SMR
MRA IMRO Guide #2: Datasources of SMR
MRA IMRO Guide #3: Data Fusion and SMR
MRA IMRO Guide #4: Reliability of SMR
Comments Off
Category conversition | Tags: Tags: annie pettit, citation, citing, conversition, guide, guidelines, imro, lovestats, market research, mra, mrx, navigating, references, reliability, smr, social media analytics, social media monitor, social media research, tessie ting, validity,
Social Networks : Technorati, Stumble it!, Digg, de.licio.us, Yahoo, reddit, Blogmarks, Google, Magnolia.
Wednesday, February 9th, 2011
MRA recently released version 1 of the MRA/IMRO Guide to the Top 16 Social Media Research Questions, a tool to help newcomers and vendors communicate with each other about this new datasource and method. Conversition was a key contributor to this document which is now available on the MRA website.
.
This blog is #10 in a series of 16, each one addressing Conversition’s viewpoint on one of the items in the guidelines. We welcome your questions and comments, and look forward to further discussions on this exciting new trend in the market research industry.
hmm360 from morguefile
What is the level of expertise and industry qualifications of social media researchers and/or SMR companies?
Social media research is a relatively new specialization in the industry of market research. It can be difficult for clients to understand the skills and expertise of their provider, most of whom have wildly different backgrounds.
Conversition’s number one skill is that of research. We are researchers who have built a research product. Our experience comes from decades of first hand experience as data collection providers, full service research providers, survey panel providers, and research client service. We have consulted with clients on research design and methodology, written surveys, analyzed surveys, written research reports, and presented reports to clients. We have conducted research on research including survey and incentive satisfaction, online survey data quality, and parallel studies. We know the intricate details of sampling, weighting, standards, norms, and scaling. We know research inside and out.
This extensive research background gives us unique insight into the desires and needs of researchers seeking a quantitative solution to the social media space and, as such, we have created a social media research tool that makes sense for researchers.
Conversition was built by researchers for researchers.
.
.
Related links
MRA IMRO Guide #1: Advantages and Disadvantages of SMR
MRA IMRO Guide #2: Datasources of SMR
MRA IMRO Guide #3: Data Fusion and SMR
MRA IMRO Guide #4: Reliability of SMR
MRA IMRO Guide #5: Responsibilities of Social Media Data Users
MRA IMRO Guide #6: Social Media Research Skills
MRA IMRO Guide #7: Research Contributor Awareness
MRA IMRO Guide #8: Citing Reference
MRA IMRO Guide #9: Legal Issues
Comments Off
Category conversition | Tags: Tags: annie pettit, citation, citing, content analysis, conversition, focus groups, guide, guidelines, imro, lovestats, market research, marketresearch, mra, mrx, navigating, newmr, references, reliability, sentiment analysis, smr, social media analytics, social media marketing, social media monitoring, social media plan, social media research, social media strategy, surveys, tessie ting, tessietweets, text analysis, validity,
Social Networks : Technorati, Stumble it!, Digg, de.licio.us, Yahoo, reddit, Blogmarks, Google, Magnolia.
Tuesday, February 8th, 2011
MRA recently released version 1 of the MRA/IMRO Guide to the Top 16 Social Media Research Questions, a tool to help newcomers and vendors communicate with each other about this new datasource and method. Conversition was a key contributor to this document which is now available on the MRA website.
.
This blog is #12 in a series of 16, each one addressing Conversition’s viewpoint on one of the items in the guidelines. We welcome your questions and comments, and look forward to further discussions on this exciting new trend in the market research industry.
clarita from morguefile
What is the process for gathering data?
Conversition specializes in the preparation of social media data for market research purposes. As such, a portion of our data is gathered by a third party which specializes in data collection from the internet. Data is gathered from millions of different websites including popular ones such as Twitter, Facebook, YouTube, and Flickr, as well as very small, personal websites that may only have a few readers.
We, and our vendors, honor all website notifications regarding crawling permissions. If a website has behind the scenes coding that says ‘do not crawl,’ then we do not crawl the website. In fact, special permissions, though not required by the website owners, have been obtained to crawl and gather data from many of the major websites.
In addition, we regularly check our processes by attempting to crawl websites that we know are password protected.
We take our data collection process very seriously and hope you appreciate that.
.
.
Related links
MRA IMRO Guide #1: Advantages and Disadvantages of SMR – The Conversition Commentary
MRA IMRO Guide #2: Datasources of SMR – The Conversition Commentary
MRA IMRO Guide #3: Data Fusion and SMR – The Conversition Commentary
MRA IMRO Guide #4: Reliability of SMR – The Conversition Commentary
MRA IMRO Guide #5: Responsibilities of Social Media Data Users – The Conversition Commentary
MRA IMRO Guide #6: Social Media Research Skills – The Conversition Commentary
MRA IMRO Guide #7: Research Contributor Awareness – The Conversition Commentary
MRA IMRO Guide #8: Citing Reference
MRA IMRO Guide #9: Legal Issues
Comments Off
Category conversition | Tags: Tags: annie pettit, citation, citing, content analysis, conversition, focus groups, guide, guidelines, imro, lovestats, market research, marketresearch, mra, mrx, navigating, newmr, references, reliability, sentiment analysis, smr, social media analytics, social media marketing, social media monitor, social media monitoring, social media plan, social media research, social media strategy, surveys, tessie ting, tessietweets, text analysis, validity,
Social Networks : Technorati, Stumble it!, Digg, de.licio.us, Yahoo, reddit, Blogmarks, Google, Magnolia.
Saturday, February 5th, 2011
MRA recently released version 1 of the MRA/IMRO Guide to the Top 16 Social Media Research Questions, a tool to help newcomers and vendors communicate with each other about this new datasource and method. Conversition was a key contributor to this document which is now available on the MRA website.
.
This blog is #11 in a series of 16, each one addressing Conversition’s viewpoint on one of the items in the guidelines. We welcome your questions and comments, and look forward to further discussions on this exciting new trend in the market research industry.
mconnors from morguefile
What are the standard data and/or research outputs?
Conversition offers clients two different outputs. First, you may choose to access our specialized website portal which allows you to look at the data live and instantly create your own charts, tables, and EvoClouds. The portal also includes a number of pre-defined reports that allow you to quickly identify and analyze the important results in your dataset.
Second, you may choose to download datapaks which are very similar to survey datasets. After uploading the files to your preferred statistical software, whether it’s SPSS, SAS, SYSTAT, or QUANVERT, you then have the utimate in flexibility. You can run any assortment of crosstabs, create new variables, or cut the data by your preferred date range.
Though we often consult with our clients on the preparation of their research reports, Conversition does not, as a regular offering, offer full-service research report writing. You are the master of your category.
.
.
Related links
MRA IMRO Guide #1: Advantages and Disadvantages of SMR
MRA IMRO Guide #2: Datasources of SMR
MRA IMRO Guide #3: Data Fusion and SMR
MRA IMRO Guide #4: Reliability of SMR
MRA IMRO Guide #5: Responsibilities of Social Media Data Users
MRA IMRO Guide #6: Social Media Research Skills
MRA IMRO Guide #7: Research Contributor Awareness
MRA IMRO Guide #8: Citing Reference
MRA IMRO Guide #9: Legal Issues
Comments Off
Category conversition | Tags: Tags: annie pettit, citation, citing, content analysis, conversition, focus groups, guide, guidelines, imro, lovestats, market research, marketresearch, mra, mrx, navigating, newmr, references, reliability, sentiment analysis, smr, social media analytics, social media marketing, social media monitoring, social media plan, social media research, social media strategy, surveys, tessie ting, tessietweets, text analysis, validity,
Social Networks : Technorati, Stumble it!, Digg, de.licio.us, Yahoo, reddit, Blogmarks, Google, Magnolia.
Tuesday, January 18th, 2011
MRA recently released version 1 of the MRA/IMRO Guide to the Top 16 Social Media Research Questions, a tool to help newcomers and vendors communicate with each other about this new datasource and method. Conversition was a key contributor to this document which is now available on the MRA website.
.
This blog is #9 in a series of 16, each one addressing Conversition’s viewpoint on one of the items in the guidelines. We welcome your questions and comments, and look forward to further discussions on this exciting new trend in the market research industry.
kconnors from morguefile
.
What are the controversies and legal issues regarding the rights of the people whose data is being used?
This topic is, excuse the formal language, ginormous. As researchers, marketers, and technology providers, people using social media data are still learning about the rights of people who create that data.
Some people feel that because the internet is a public space, anyone can go online and gather data from anywhere, from anyone, for any purpose, even if it takes a couple of minutes to generate a password to access the data. Some people take another extreme and feel that no data should be collected without the explicit permission of the person who has created the data.
The Conversition position falls in the middle.
We believe that password protection signals a desire for privacy. Even if it is possible to create a password and enter a site within a minute, data should not be gathered from the site.
We believe that social media data should not be shared verbatim in research reports. Verbatim comments are easily searchable online and individuals can be quickly and easily identified. Comments which may seem benign to us may be embarrassing or damaging to the person who wrote them, a person who may not have understood which types of data on the internet are and are not public.
We believe that people creating information on the internet should not be engaged with for research purposes until after they have specifically given permission to continue the contact for that purpose.
We believe that the rights of the individual come ahead of the desires of the researcher. Just as surveys and focus groups are created with the safety of the individual in mind, and this means writing non-threatening surveys and finding physically safe focus group locations, so should social media research processes ensure that the safety of the individual comes first.
The legalities of social media data collection and use still need to be determined and they will vary on a country by country basis. But, while the legalities are still being determined and after they are determined, we plan to respect the individual.
.
.
Related links
MRA IMRO Guide #1: Advantages and Disadvantages of SMR
MRA IMRO Guide #2: Datasources of SMR
MRA IMRO Guide #3: Data Fusion and SMR
MRA IMRO Guide #4: Reliability of SMR
MRA IMRO Guide #5: Responsibilities of Social Media Data Users
MRA IMRO Guide #6: Social Media Research Skills
MRA IMRO Guide #7: Research Contributor Awareness
Comments Off
Category conversition | Tags: Tags: annie pettit, controversy, conversition, ethics, imro, legal, lovestats, market research, mra, mrx, navigating, rights, social media analytics, social media monitor, social media research, tessie ting,
Social Networks : Technorati, Stumble it!, Digg, de.licio.us, Yahoo, reddit, Blogmarks, Google, Magnolia.
Wednesday, January 5th, 2011
MRA recently released version 1 of the MRA/IMRO Guide to the Top 16 Social Media Research Questions, a tool to help newcomers and vendors communicate with each other about this new datasource and method. Conversition was a key contributor to this document which is now available on the MRA website.
.
This blog is #8 in a series of 16, each one addressing Conversition’s viewpoint on one of the items in the guidelines. We welcome your questions and comments, and look forward to further discussions on this exciting new trend in the market research industry.
kevin_p from morguefile
How are sources cited in research reports and on research Web portals? Are the citations different based on the source, e.g., Twitter, Blogger, forums?
Marketing research is not the same as academic research that takes place in a library. Though it is possible to gather social media data and specifically identify the website link, and even the individual person creating the information, that doesn’t mean it’s appropriate to do so. Social media data is research data that should be treated as similarly as possible to other forms of research data.
In surveys and focus groups, we promise participants that we will not share their names or other personally identifiable information with clients. We never include email addresses, phone numbers, or personal data in client reports. This is probably why people share so many intimate details with us – they didn’t write their name on the survey and their name won’t be in the research report.
However, the mere process of collecting social media data means that individuals are identifiable. Their name is usually right beside their research contribution. Sometimes, their age, gender, and address are right beside their contribution as well. But, as always, just because we have it doesn’t mean we should share it in reports.
It is common practice to provide links in social media portals. This allows researchers to click through the link and read comments in context. It ensures that opinions can be fully understood before they are aggregated into a representative research result. It is a method for validating the finding and the accuracy of the end result. The purpose of market research is not to respond to individual people nor even to evaluate individual people. The purpose of market research is to aggregate data to achieve a broad understanding of a community. As such, there is no need to include personally identifying information in the next stage of the research process, the research report.
Research reports should not include personally identifiable information such as links or names. But, it is entirely appropriate for reports to indicate that “15% of results were sourced from Twitter” or that “86% of Foursquare users are extremely satisfied with the brand whereas only 26% of Blogger users are extremely satisfied.” But to go one step further and name names just isn’t in keeping with the spirit of market research.
There are, of course, exceptions to the rule. Chances are that public figures expect their opinions to be shared in an identifiable way. Massively popular blogs like Mashable and Techcrunch expect people to directly quote and link to them. Politicians like Obama and Stephen Harper expect to be directly quoted. (I bet you’re wondering who Stephen Harper is.) And, even yours truly expects that people will quote this blog directly.
Exceptions to the rule do not make the rule. If you do not know, without a doubt, that the person would expect their comments to be quoted, then adhere to the rule of privacy. No citations in reports.
.
.
Related links
MRA IMRO Guide #1: Advantages and Disadvantages of SMR
MRA IMRO Guide #2: Datasources of SMR
MRA IMRO Guide #3: Data Fusion and SMR
MRA IMRO Guide #4: Reliability of SMR
MRA IMRO Guide #5: Responsibilities of Social Media Data Users
Comments Off
Category conversition | Tags: Tags: annie pettit, citation, citing, conversition, imro, lovestats, mra, mrx, references, smr, social media analytics, social media monitor, social media research, tessie ting, tessietweets,
Social Networks : Technorati, Stumble it!, Digg, de.licio.us, Yahoo, reddit, Blogmarks, Google, Magnolia.
Wednesday, December 29th, 2010
Your best bet for market research news is to start with the organization(s) in your country. They will have the most up-to-date legal and ethical opinions on issues that are unique to your region. But once you have that covered, you can learn a lot about your industry by keeping in touch with the various organizations around the world. Most of them welcome memberships from the global community particularly as our research focuses on the global community. Here are just a few of the English organizations that may be of interest to you.
….
.
CASRO – Council of American Survey Research Organizations
ESOMAR – European Society for Opinion and Marketing Research
MRA – Marketing Research Association (US)
IMRO – Interactive Marketing Research Association (US, part of MRA)
MRIA – Marketing Research and Intelligence Association (Canada)
AMSRS – Australian Market and Social Research Society
MRS – Marketing Research Society
.
There are also many other independent websites to help you stay on top of the MR scene. You can’t possibly participate in all of them as there are far too many and they are spread across Facebook, LinkedIn, and private sites, but not to worry as you’ll find a lot of duplication among them. You’ll probably catch most things with just these few sites. Say good-bye to free time!
.
All Top Market Research – Blog listings for any topic, including MR
MrWeb – Great site for MR news updates, plus frequent email updates if you wish
Market Research World – MR news updates, plus email updates
Research Live – Great site for MR news updates, plus frequent email updates if you wish
Comments Off
Category conversition | Tags: Tags: all-top, annie pettit, bmra, casro, conversition, esomar, imro, kawasaki, lovestats, market research, mra, mria, mrnews, mrs, researchlive, social media analytics, social media monitor, tessie ting, tessietweets,
Social Networks : Technorati, Stumble it!, Digg, de.licio.us, Yahoo, reddit, Blogmarks, Google, Magnolia.
