Read Annie’s award-winning paper!

Friday, October 5th, 2012

Congrats to our own Annie Pettit, who won the David K. Hardin Memorial Award for the best article or paper, based on innovativeness of the research, its usefulness and applicability for other researchers, and the potential societal or economic benefits or implications of the research, published in Marketing Research in 2011.

You can download the winning paper, “The Promises and Pitfalls of SMR,” which was published last September, from our Resources page. Here’s the abstract:

Social media research holds a great deal of promise for those who can tap into its tremendous potential. As this article points out, it is likely to succeed in areas such as tracking research, campaign research, usage and attitude research, and segmentation research. Like any new methodology, however, SMR it has its share of perils and disappointments. Despite some unresolved issues with data reliability and quality, the science of SMR seems destined to prevail.

Congratulations again, Annie!

Annie on Radio NewMR

Tuesday, September 11th, 2012

Want to hear what Conversition CRO Annie Pettit really thinks about social media research? Annie was one of the guests this week on Radio NewMR, where she talked about how she got interested in social media, misconceptions in social media research, the future of the space and more.

Check out the recording of the show here or go here for a link to download the podcast.

Correlating Gas Prices with Social Media Sentiment

Friday, July 20th, 2012

Sentiment analysis isn’t perfect and anyone who has tried to do it with social media data will confirm that. The nuances of language, including sarcasm, emoticons, slang, spelling errors, grammar creativity, and more mean that 100% accuracy is simply unattainable. But in market research, we aren’t looking for 100% accuracy, not even 90% accuracy. We know those kinds of numbers are unrealistic. What we expect, however, is to see that social media data has some relationship with real world data. And that is what we investigated here.

This project began by simply finding a third party source of fuel prices and we turned to Gasbuddy to give us average monthly US gas prices. Given that we estimated data points by carefully eyeballing a chart on the screen, the Gasbuddy numbers aren’t accurate to the last decimal place. But if you compare our Gasbuddy chart with the official chart, you’ll see that the trend is accurate. This is our criterion dataset.

The second dataset came from Conversition’s Evolisten database. We collected hundreds of thousands of verbatims from thousands of websites all of which in some way referenced fuel or gas prices or costs. Twitter, Facebook YouTube, Flickr, any type of website where people felt like sharing their opinions about gas prices was our target. After cleaning out the spam, we measured the sentiment of the remainder of opinions. Then, we calculated the inverse of the sentiment score. For example, a score of 5 (very positive) was changed to 1 (very negative), and a score of 1 was changed to a 5.

What you see in this chart is a correlation of 0.65. In other words, as the price of gas increases, sentiment decreases.

It just makes me think… what if everyone tweeted and messaged that the price of gas was really low. Could we turn this correlation into causation? It’s worth a try!

Tea Parties and Turmoil, an Esomar Webinar

Tuesday, November 1st, 2011

Don’t worry! If you missed the Esomar webinar, here are the slides for you to enjoy on your own. Welcome to the summer of Tea Parties and Turmoil: Measuring the summer of riots in London

Conversition Survey Reveals Attitudes towards Social Media Monitoring & Analysis Tools and Technology

Wednesday, October 26th, 2011

.
.
81 Percent of Market Research Agencies Agree Social Media can Complement Insights Generated by Traditional Research Methods
.
Toronto, ON – October 27, 2011 – Conversition, a pioneer in the Social Media Research industry, recently surveyed 601 clients of Research Now to determine their usage and attitudes towards social media data platforms for the purposes of measuring consumer engagement and gaining consumer insights.

Conversition conducted a 15 minute study focused on the usage of social media monitoring tools and technology to engage consumers, or gain insight into their existing or emerging needs. In order to fully comprehend the potential that the Social Media Monitoring & Analysis (SMMA) industry has in different markets, Conversition surveyed Research Now clients based in the United States, the United Kingdom and Canada.

The findings showed highly encouraging results for an industry quickly being adopted by researchers. In particular, responses regarding the use of social media for insight purposes illustrates that SMMA has entered the „early majority‟ within prime English-speaking markets. More specifically, 81 percent of all market research agencies (MRAs) surveyed agree that SMMA can complement insights from custom and/or ad hoc quantitative and qualitative research.

When asked specifically about the potential that SMMA has:

• 65 percent of all responding companies agree that SMMA will become a substantial channel for market research in the future.
• 63 percent of all responding companies agree that SMMA has immense potential to drive consumer insights.

“What’s clear from the study is that the market research community is ‘switching on’ to the power and insight potential of social media data,” commented Michael Mayers, Vice President of Business Development at Conversition.

The survey also found that:

• 85 percent of MRAs believe that human intervention is still needed to maintain the quality of social media data.
• 58 percent of MRAs believe that data quality issues (e.g. spam, erroneous data, and difficulty of understanding the demographic profile of respondents) currently restrict the use of SMMA for insight purposes.

.
Mayers adds, “Social media data represents an emerging research channel, and data from social media can be a rich source of information for consumer insights. At the same time, perceptions over data quality are an issue, and our response is that whether managed by the client or the vendor, social media data requires the involvement of experienced and knowledgeable humans to provide those all important checks and balances.”

Methodology
Fieldwork was conducted between August 19 and September 15, 2011 among 601 clients of Research Now based in the United States, the United Kingdom and Canada. The breakdown by country was as follows: United States (344), United Kingdom (165) and Canada (91).

About Conversition
Conversition is an online social media data collection business unit based in Toronto, Canada and New York, NY. Conversition listens to consumers by applying scientific principles to the collection and analysis of social media data. Its strength lies in combining the expertise of respected market researchers with an in-depth understanding of social media.

About Research Now
Research Now is the leading global online sampling and online data collection company. With over 6 million panelists in 38 countries worldwide, Research Now enables companies to listen to and interact with real consumers and business decision makers in order to make key business decisions. Research Now offers a full suite of data collection services, including social media sampling, and operates the Valued Opinions™ Panel and e-Rewards® Opinion Panels. The company has a multilingual staff located in 22 offices around the globe and has been recognized for four consecutive years as the industry leader in client satisfaction. Visit http://www.researchnow.com to learn more.

Press Contact:
Heather Milt
1-206-200-8207
hmilt@researchnow.com

For a copy of the full report, please email hello@conversition.com.

Social Media Sentiment: H8ers and

Monday, August 15th, 2011

H8ers! <3ers! Isn’t social media just full of people who have radical opinions? It’s been a while since we first shared information about the distribution of opinions/sentiment in social media so we thought it was about time we conducted our little experiment again.

For six different sets of data, we gathered hundreds of thousands of sentiment scores and prepared frequency distributions of the results. As you can see below, some brands have more positive (A, B) sentiment while others have more negative (C, E, F) sentiment. You can also see that some brands have more flat (E) or peeked (C) distributions, or longer tails (A, B). No matter which particular feature of a brand’s chart interests you, it is clear that all of the distributions are reasonably normal, they are generally bell shaped.

So is social media full of haters and lovers? Most definitely not. Most social media data consists of lots of moderate like and dislike, plus a healthy representation of haters and lovers. Now the only puzzle is determining which of these charts reflects the sentiment of 1) autism, 2) Lady Gaga, 3) Obama, 4) Steve Jobs, 5) Toyota, and 6) Walmart.

.
.
Related links
Are Only Crazy People Commenting About Brands in Social Media?
Article in the Vue: Words I’ll Live to Regret
Cell + Survey + SMR: A Social Media Mashup #MRIA2011 #MRA_AC #MRX
There is no question but the research validity question

.

Upcoming ESOMAR 3D presentation: Tell me what you want, what you really, really want

Tuesday, July 26th, 2011

3D DIGITAL DIMENSIONS 2011
(ONLINE + SOCIAL MEDIA + MOBILE) RESEARCH
MIAMI / 26 – 28 OCTOBER

.
TELL ME WHAT YOU WANT, WHAT YOU REALLY, REALLY WANT
CREATING DESIRED RESULTS FROM SOCIAL MEDIA RESEARCH

Annie Pettit, Conversition and Research Now, Canada
.
This presentation will teach you how to generate the social media research results you desire regardless of what the true results are. I will demonstrate how to gather social media data from the internet using inappropriate sampling methods, and how to select the wrong pieces of data and code it incorrectly. The topics of sampling, weighting, data quality, sentiment analysis, and text analysis will be highlighted so that you can understand the full range of options for mistreating data. The ultimate goal will be to create set of data that reflects our predispositions towards a topic as opposed to reality.

Attendees are required to come prepared with a sense of humour  (i.e., I will be speaking in jest!)

Social Media Sentiment: H8ers and <3ers

Friday, July 8th, 2011

H8ers! <3ers! Isn’t social media just full of people who have radical opinions? It’s been a while since we first shared information about the distribution of opinions/sentiment in social media so we thought it was about time we conducted our little experiment again.

For six different sets of data, we gathered hundreds of thousands of sentiment scores and prepared frequency distributions of the results. As you can see below, some brands have more positive (A, B) sentiment while others have more negative (C, E, F) sentiment. You can also see that some brands have more flat (E) or peeked (C) distributions, or longer tails (A, B). No matter which particular feature of a brand’s chart interests you, it is clear that all of the distributions are reasonably normal, they are generally bell shaped.

So is social media full of haters and lovers? Most definitely not. Most social media data consists of lots of moderate like and dislike, plus a healthy representation of haters and lovers. Now the only puzzle is determining which of these charts reflects the sentiment of 1) autism, 2) Lady Gaga, 3) Obama, 4) Steve Jobs, 5) Toyota, and 6) Walmart.

.
.
Related links
Are Only Crazy People Commenting About Brands in Social Media?
Article in the Vue: Words I’ll Live to Regret
Cell + Survey + SMR: A Social Media Mashup #MRIA2011 #MRA_AC #MRX
There is no question but the research validity question

.

Dear Brand, you are never to talk to me even if I talk to you first: The Social Media Puzzle

Tuesday, July 5th, 2011

Ok, so in the last couple of posts, we agreed that not everyone feels comfortable about brands responding to comments they make online. Sometimes, people want to make a comment and then just be left alone. But when is it acceptable for brands to respond?

We conducted an online survey (based on the e-Rewards survey panel) to determine how people feel about companies responding to them about a comment they made in the social media space. We surveyed a census representative sample of 1000 Americans and 1000 Canadians to find out in which situations they thought it was appropriate for a company to respond to them about comments they’ve written in social media.

First of all, it’s interesting to see that there are no situations where there is 100% (or even 90% or 80%) agreement that it is appropriate for a brand to respond. In fact, even when people write a comment on a brand’s website, only about 54% of people think it’s acceptable for the brand to respond to them. And, it doesn’t matter if they casually mention a brand or tweet directly to them, about a quarter of people indicated “it is never appropriate for a company to respond to you about comments you have written in social media.” Wow!

So who are these people who think it is never appropriate for a company to respond to them? Perhaps it is some odd, demographically unique group of people? No. It’s very slightly more men, slightly fewer younger people, slightly more uneducated people, and slightly more people without children. Just remember, when you generalize to say that most people are ok when a brand responds to their comments in social media, you’re ignoring the preferences of a lot of people. 26% of people.

Commenting in social media means you want a response, right? Wrong!

Thursday, June 30th, 2011

If you talk to people about social media engagement, you’ll hear a common thread – people want to be responded to when they make a comment about a brand or company in social media. People like it, they expect it, it should happen. This always makes me wonder about people who make comments online but don’t necessarily want to chat with the company. Do such people exist?

We conducted an online survey (based on the e-Rewards survey panel) to determine how people feel about companies responding to them about a comment they made in the social media space. From a census representative sample of 1000 Americans and 1000 Canadians, we identified 152 people who said a company had responded to them when they made a comment online.

Given a multiple choice question listing a number of positive, negative, and neutral feelings, we asked survey responders to select as many items as appropriate to describe how they felt (which means these numbers will add up to more than 100%).

About 41% of people said that they liked being responded to and about 40% of people said they appreciated being responded to. That is a nice, healthy, positive number. However, about 10% of people were annoyed and about 10% felt that they were being stalked. Would you be comfortable annoying 1 out of every 10 people you talked to?

Now, if about 41% of people liked or appreciated it when the company responded to them, that left a lot of people who did NOT necessarily like or appreciate the response. Perhaps they didn’t care one way or the other, or they actually disliked it. Either way, they did not feel the need to indicate that they liked the response. What are the demographics of the group of people who didn’t like the interaction?


.
So now let’s think again about the generally agreed upon idea that people want to be responded to when they write something about a brand online. Is that really true? I don’t think so.

.
.
Related links
Are Only Crazy People Commenting About Brands in Social Media?
There is no question but the research validity question
Cell + Survey + SMR: A Social Media Mashup

.

6CFBPK6DVC9T