Study finds paid search ads don't always pay off

January 22, 2014

Businesses spend billions to reach customers through online advertising but just how effective are paid search ads? Using data from eBay, economist Steven Tadelis at UC Berkeley's Haas School of Business compared whether consumers are more likely to click on paid ads than on free, generic search results and found that advertisers may not be getting their money's worth.

"We found that when you turn off the paid advertising, almost all of the traffic that came through the paid search is just substituted by the other free channels," says Tadelis, associate professor in the Haas Business and Public Policy Group. Tadelis conducted the study, "Consumer Heterogeneity and Paid Search Effectiveness: A Large Scale Field Experiment," at eBay. The study was co-authored by Thomas Blake, an economist in the economics research team that Tadelis started at eBay, and former eBay economist Chris Nosko of the University of Chicago.

To measure the effectiveness of paid search, the researchers turned off eBay's paid search in 68 direct marketing areas in the U.S. In other words, if a consumer typed in the search term "white blouse" while online in these markets, he or she would only see the generic search results at the top of the list; not the paid ad that typically appears in a shaded box at the top of the search. She would not see any retail ads by eBay for "white blouse" but only from other advertisers who bid on the "white blouse" keywords.

This video is not supported by your browser at this time.

At the end of 60 days, Tadelis and his colleagues compared sales of two groups: one group that received no paid search results and another group in which paid search remained untouched. Again, consumer sales as a result of the paid search showed no measurable increase off those who made purchases via unpaid channels (such as organic searches, or directly visiting

In order to ensure the robustness of their results, in a second experiment, the researchers also eliminated eBay's paid keyword searches throughout the country and then compared sales for that period to an equivalent period with paid search on.

"If advertising is indeed a strong driver of sales, we should have seen sales plummet," says Tadelis. "But the impact on was indistinguishable and not significantly different than zero."

Furthermore, for "brand" keywords such as "eBay" or other company name keywords, paid ads sit just above the generic . For example, a search for "Macy's" results in a Macy's free search below the Macys paid ad. Consequently, Tadelis says the paid search result adds no additional benefit to the advertiser. "It's not that clicking on the result caused engagement, it's that the intent to engage caused people to click on it," says Tadelis.

On any given day advertisers, including eBay, bid on millions of keywords. Tadelis hopes their work will encourage other e-commerce businesses to conduct this type of microeconomic research to better measure the impact of paid search traffic on the web.

Explore further: Brand name advertising clicks with online shoppers

More information: See full paper:

Related Stories

Brand name advertising clicks with online shoppers

October 3, 2011

( -- Brand names in online search engine advertising campaigns can attract more attention and encourage more sales than campaigns that use generic terms, according to Penn State researchers.

Google loses Australian advert cases

April 3, 2012

Internet giant Google was Tuesday found guilty of false and misleading advertising in Australia after a court upheld an appeal by the country's competition regulator.

US tightens guidance for online search ads

June 25, 2013

A US consumer watchdog agency told Internet search engines Tuesday to ensure they differentiate between search results and paid advertising, to steer clear of "deceptive" practices.

Recommended for you

Drone market to hit $10 billion by 2024: experts

October 3, 2015

The market for military drones is expected to almost double by 2024 to beyond $10 billion (8.9 billion euros), according to a report published Friday by specialist defence publication IHS Jane's Intelligence Review.

Radio frequency 'harvesting' tech unveiled in UK

September 30, 2015

An energy harvesting technology that its developers say will be able to turn ambient radio frequency waves into usable electricity to charge low power devices was unveiled in London on Wednesday.

Professors say US has fallen behind on offshore wind power

September 29, 2015

University of Delaware faculty from the College of Earth, Ocean, and Environment (CEOE), the College of Engineering and the Alfred Lerner School of Business and Economics say that the U.S. has fallen behind in offshore wind ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.