Companies Beware of Biased Consumers

May 26, 2010 By Aaron Mays

( -- Marketers frequently rely upon surveys to gain insight into consumers' opinions and preferences. These results have important implications, ranging from the decision to add new product features to multi-million dollar rebranding efforts.

Gathering consumer insights is critical for any successful ; yet, new research from the Kellogg School at Northwestern University reveals a potentially pervasive form of bias if surveys are not executed effectively.

In “Answering the Unasked Question: Response Substitution in Consumer Surveys,” Kellogg marketing professors David Gal and Derek Rucker have discovered a hidden bias when it comes to survey responses. In a series of three experiments, the researchers found that have a tendency to misrepresent their opinions on surveys because they want to express opinions that were not asked, a phenomenon they have coined “response substitution.”

“Customers express their identity through the products and brands that they buy and own,” said Rucker, an associate professor of marketing. “We suggest consumers have a need to express themselves through their attitudes as well; because the need for expression can be great, when consumers cannot share their opinions they might just express them on an unrelated question, creating a bias.”

For example, imagine a customer who dined at a restaurant with terrible service and management. Later on, he is asked to fill out a survey about the quality of the food. The new study suggests that some respondents, such as this fictional customer, would use this opportunity to express their dislike toward the organization, even if they perceive that establishment to possess other redeeming qualities (such as excellent cuisine).

“Since the survey does not ask about the service at the restaurant, the only means for this unhappy customer to express his general disapproval of the service is by being negative about the food,” said Gal, an assistant professor of marketing. “Basically, respondents have the potential to project their negative attitudes onto the wrong aspect of the business so they can share their opinions. This bias can be a major source of misdirection for a company.”

To test their theory, the researchers devised three experiments. In one, participants were asked to evaluate the quality of candy produced by a company with immoral business practices. The Kellogg researchers discovered that individuals who viewed a company’s moral behavior as very important to their purchasing decisions rated the product quality of the candy poorly compared to respondents who did not view the company’s actions as very important to their purchasing decisions. Participants who felt strongly about the company’s actions were not only evaluating the candy’s quality but were using the quality rating as a means to express their disapproval toward the company’s practices.

Fortunately, there are ways managers and marketers can intervene. The authors suggest explicitly providing a place for people to express their opinions on the survey can help to minimize sources of survey bias.

“One simple remedy,” said Rucker, “is to inform respondents upfront that they will have an opportunity to express any other thoughts they might have in an open-ended format. That way, respondents can share any other opinions not intended for the survey.” Indeed, the researchers found that such a simple intervention significantly reduced response substitution.

Rucker and Gal also suggest questions be worded properly to limit misinterpretation and to improve comprehension.

The study will appear in a forthcoming issue of the Journal of Marketing Research.

Explore further: Do government technology investments pay off?

Related Stories

Negativity is contagious, study finds

Oct 04, 2007

Though we may not care to admit it, what other people think about something can affect what we think about it. This is how critics become influential and why our parents’ opinions about our life choices continue to matter, ...

Online surveys are less effective than phone surveys

Jul 17, 2006

Surveys are more than an annoyance. They are also a useful tool for market researchers, who rely on them to understand our attitudes towards products. However, a significant new study in the September issue of the Journal of ...

The freedom of power

Dec 01, 2008

With the forthcoming inauguration this January, the nation will be closely watching to see how the President Elect will respond to the advice, influence, and criticism of his advisors, cabinet members, media, and other political ...

Can't find the perfect gift?

Dec 18, 2007

Why is it so hard to choose the perfect gift? One reason is that we know less than we think we do about each others' likes and dislikes, and it's worse for things we like ourselves, says a University of Michigan business ...

People more likely to overestimate their credit quality

Jun 02, 2008

A new study published in the Journal of Consumer Affairs examined consumers' self-assessments of their credit rating and found that respondents were more likely to believe they had average or above average credit and those ...

Recommended for you

Do government technology investments pay off?

Mar 30, 2015

Studies confirm that IT investments in companies improve productivity and efficiency. University of Michigan professor M.S. Krishnan wondered if the same was true for government.

Study finds assisted housing works, but it could be improved

Mar 30, 2015

Two researchers from the University of Kansas Department of Urban Planning have just completed a study on the locations of assisted housing units and assisted households across the nation. It examines one of the key issues ...

Economist probes the high cost of health care

Mar 27, 2015

When Zack Cooper arrived at Yale as assistant professor of public health and economics, he gained access to a first-of-its-kind dataset. Working with the non-profit Health Care Cost Institute, Cooper and ...

Cash remains king in Chile but its days could be numbered

Mar 26, 2015

For more than a year now, Chileans have endured a crisis of cash access. Despite global moves toward new forms of payment such as contactless and mobile transfers, the crisis in Chile highlights the continuing ...

User comments : 0

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.