Over 80 percent of online ad effect is on offline sales

February 2, 2017, Institute for Operations Research and the Management Sciences
Credit: George Hodan/Public Domain

According to a forthcoming study in the INFORMS journal Marketing Science online display ads can increase both online and offline retail sales, providing valuable insight for future marketing decisions.

The study titled "When Less is More: Data and Power in Advertising Experiments" was authored by Garrett Johnson of the University of Rochester, Randall Lewis of Netflix, and David Reiley of Pandora, who were all conducting research for Yahoo! at the time of the study.

The Yahoo! researchers worked with an unnamed national apparel retailer to evaluate the effects of the retailer's . They collaborated on a large-scale field experiment involving over 3 million Yahoo! users. For two weeks, Yahoo! users in the experiment's treatment group saw branded apparel ads from the retailer whereas users in the saw ads for Yahoo! Search. Relative to the baseline established by the control group, the experiment showed that the retailer's campaign increased sales by 3.6 percent or roughly three times the retailer's spending on ads.

Reiley said, "This apparel retailer approached us with an interesting problem: 'How do I know if my online ads work when 90 percent of my sales are offline?'"

The authors attacked this problem by matching customer records between the retailer and Yahoo!. Importantly, the authors combined customer-level online and offline sales data with a controlled experiment that allowed them to assess how much the consumers would have purchased in the absence of the ad campaign. They determined that 84 percent of the sales increase from the ads came from offline sales. Reiley added, "Without the experiment, the retailer could have erroneously concluded that the ads only increased online sales and not offline sales. Ironically, this could have led to underinvestment in online advertising."

The study notes that their novel experimental design can be valuable for companies seeking to measure advertising effectiveness. Lewis noted, "We'd run experiments with this retailer before, but this was the largest experiment where we used 'control ads' to determine which control-group members would have seen the ads. This allowed us to ignore statistical noise from the purchases of consumers who never saw the ads. We also discovered that we only needed to look at after the first ad because an ad can only affect you after you have seen it. These two tricks allowed us to improve the statistical precision of the estimated benefits from advertising."

The improvement in precision from using control ads is critically important for managers making advertising decisions. Johnson explained, "Ad effectiveness estimates tend to be small, but also imprecise. Even with a study of 3 million users, standard methods to improve precision by controlling for customer's past behavior and demographics were less effective than most expected. However, by making full use of the control ads, we further improved by six times the statistical precision of our ad effects estimates. For managers, this improvement could be the deciding factor in learning whether has a clear and statistically significant positive impact. We hope the ideas in our design can help firms invest confidently in ad campaigns when they are likely to be profitable."

Explore further: It pays to go beyond the last word when advertising using Google AdWords

Related Stories

How 5-star online customer reviews can backfire

August 2, 2016

It may be counterintuitive, but the more positive online reviews a product gets may actually lead to a net negative profit for the retailer. That's the conclusion of new research by a team of marketing experts from a Dutch ...

Brand name advertising clicks with online shoppers

October 3, 2011

(PhysOrg.com) -- Brand names in online search engine advertising campaigns can attract more attention and encourage more sales than campaigns that use generic terms, according to Penn State researchers.

How social media impacts consumer spending

November 17, 2016

For businesses using social media, posts with high engagement have the greatest impact on customer spending, according to new research from the University at Buffalo School of Management.

Web panels build customer loyalty

June 2, 2016

Sally Fields's famous Academy Award outburst of gratitude - "You like me, you really like me" - apparently holds true for customers who are asked to participate in retailer-sponsored Web panels, according to an article forthcoming ...

Why daring to compare online prices pays off offline

April 7, 2015

The sudden closures of big-box stores like Future Shop and Target may make it seem like online shopping is killing real-world stores. But shoppers are actually engaging in "web-to-store" shopping—buying offline after comparing ...

Recommended for you

Engineering cellular function without living cells

March 25, 2019

Genes in living cells are activated – or not – by proteins called transcription factors. The mechanisms by which these proteins activate certain genes and deactivate others play a fundamental role in many biological processes. ...

What ionized the universe?

March 25, 2019

The sparsely distributed hot gas that exists in the space between galaxies, the intergalactic medium, is ionized. The question is, how? Astronomers know that once the early universe expanded and cooled enough, hydrogen (its ...

Catalyst advance removes pollutants at low temperatures

March 25, 2019

Researchers at Washington State University, University of New Mexico, Eindhoven University of Technology, and Pacific Northwest National Laboratory have developed a catalyst that can both withstand high temperatures and convert ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.