Study suggests polling is still best predictor of election outcomes

February 2, 2017, University of Houston
Credit: Karen Arnold/public domain

Donald Trump's surprising election as president of the United States was viewed by some people as evidence that electoral polling no longer works, but researchers report they have developed models using global polling data that can correctly predict up to 90 percent of election outcomes around the world.

The study, published Feb. 2 in the journal Science, focused on executive elections in which voters cast ballots directly for the person who will hold executive office, rather than having that leader elected by parliament. The researchers say it offers strong evidence that polling data, used correctly, is the best predictor of .

"This study suggests polling data can be utilized not just in the United States but globally to predict election outcomes," said political scientist Ryan Kennedy of the University of Houston's Center for International and Comparative Studies and lead author on a paper published Feb. 2 in the journal Science. "It would be a mistake to abandon the enterprise. The future really is in trying to make better quantitative predictions."

Researchers tested the model as part of a project sponsored by the Intelligence Advanced Research Projects Activity, part of the Office of the Director of National Intelligence, which supports research with applications for the intelligence community. They submitted forecasts two weeks prior to elections in Latin America in 2013 and 2014 and correctly forecast the winners in 10 out of 11 elections, or 90.9 percent of the time.

A second test, involving live predictions for all global direct executive elections starting in mid-2013, had a success rate of 80.5 percent.

The model was developed using an election dataset covering more than 500 elections in 86 countries, along with a separate dataset that incorporated polling data from 146 elections. In addition to Kennedy, authors on the paper were Stefan Wojcik and David Lazer, both affiliated with the Lazer Lab at Northeastern University and the Institute for Quantitative Social Science at Harvard University.

They discovered that economic growth had little impact on election outcomes. "Although there is a long literature on the effect of in elections, we found little to suggest a global rule, with only minor impacts for inflation observed," they wrote. "Less democratic institutions, unsurprisingly, tended to favor the incumbent party."

Political scientist Ryan Kennedy discusses research showing the value of global polling data in predicting electoral outcomes. Credit: University of Houston

Kennedy said open democratic elections and whether one candidate was an incumbent improved the likelihood of accurate predictions. "The person who holds the seat is able to use their power and name recognition to win subsequent elections."

But, he said the most valuable predictor proved to be polling results, something that proved true across the globe.

"People normally wouldn't find this surprising. but given the recent (U.S. presidential) , now it does seem surprising," he said. "Where there was a poll, it was reasonably good at predicting outcomes, even in places you wouldn't think you'd be able to have accurate polling."

Polling techniques used for decades in the United States also are successful in countries without a history of effective polling, Kennedy said.

The researchers say their findings are especially salient in light of Trump's victory, which prompted predictions of the death of data and polling.

Not so, said Kennedy, noting that he and his collaborators predicted an 84 percent chance of a Clinton victory. "That meant a 16 percent chance of a Trump victory," he said. "Unlikely but still possible.

"We often think anything over 50 percent means absolutely an outcome is going to happen. That's not necessarily the case."

Explore further: Like polls, prediction markets failed to see Trump's victory coming, economist says

More information: "Improving election prediction internationally," Science, science.sciencemag.org/cgi/doi … 1126/science.aal2887

Related Stories

Big data analytics—Nostradamus of the 21st century

November 30, 2016

With much of the debate as to whether Donald Trump or Hillary Clinton would win the election taking place online, people blogging, tweeting or updating social media with their thoughts on the topic provided data researchers ...

Recommended for you

Fat from 558 million years ago reveals earliest known animal

September 20, 2018

Scientists from The Australian National University (ANU) and overseas have discovered molecules of fat in an ancient fossil to reveal the earliest confirmed animal in the geological record that lived on Earth 558 million ...

6 comments

Adjust slider to filter visible comments by rank

Display comments: newest first

tblakely1357
5 / 5 (2) Feb 02, 2017
Well if you don't rig the polls to support whomever financed the poll or for your own agenda then perhaps.
evropej
1 / 5 (1) Feb 02, 2017
Recent election results might say otherwise.
rderkis
1 / 5 (1) Feb 02, 2017
Poling results released before a winner is named should be banned because it unfairly compromises what might otherwise be a fair election.
zorro6204
1 / 5 (1) Feb 04, 2017
"Poling results released before a winner is named should be banned because it unfairly compromises what might otherwise be a fair election."

I don't think you could do that, but polls are just another way for the media to sensationalize elections. What point is there to polling? Just hold the election, that tells you the outcome, what possible public purpose is served by trying to predict it?
ulao
1 / 5 (1) Feb 05, 2017
Zorro you are correct:
Just hold the election, that tells you the outcome, what possible public purpose is served by trying to predict it?
However on the first point you are not correct. Polling results most definitely are intended to steer the result. You have to be naive to believe otherwise.

OdinsAcolyte
5 / 5 (1) Feb 09, 2017
One should include the word honest in the polling.
Honesty is the questions and honesty in the evaluation.
Why predict? In an honest system the will of the voter is done....
we don't have an honest system. Almost anything involving politics is inherently corrupt.
That corruption shall extend to all it touches.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.