Twitter bots had 'disproportionate' role spreading misinformation in 2016 election: study

Study: Twitter bots had 'disproportionate' role spreading misinformation in 2016 election
The spread of an article that claimed 3 million illegal immigrants voted in the 2016 U.S. presidential election. The links show the article's spread through retweets and quoted tweets, in blue, and replies and mentions, in red. Credit: Filippo Menczer, Indiana University

An analysis of information shared on Twitter during the 2016 U.S. presidential election has found that automated accounts—or "bots"—played a disproportionate role in spreading misinformation online.

The study, conducted by Indiana University researchers and published Nov. 20 in the journal Nature Communications, analyzed 14 million messages and 400,000 articles shared on Twitter between May 2016 and March 2017, a period that spans the end of the 2016 presidential primaries and the presidential inauguration on Jan. 20, 2017.

Among the findings: A mere 6 percent of Twitter accounts that the study identified as bots were enough to spread 31 percent of the "low-credibility" information on the network. These accounts were also responsible for 34 percent of all articles shared from "low-credibility" sources.

The study also found that bots played a major role promoting low-credibility content in the first few moments before a story goes viral.

The brief length of this time—2 to 10 seconds—highlights the challenges of countering the spread of misinformation online. Similar issues are seen in other complex environments like the stock market, where serious problems can arise in mere moments due to the impact of high-frequency trading.

"This study finds that bots significantly contribute to the spread of misinformation online—as well as shows how quickly these messages can spread," said Filippo Menczer, a professor in the IU School of Informatics, Computing and Engineering, who led the study.

The analysis also revealed that bots amplify a message's volume and visibility until it's more likely to be shared broadly—despite only representing a small fraction of the accounts that spread viral messages.

"People tend to put greater trust in messages that appear to originate from many people," said co-author Giovanni Luca Ciampaglia, an assistant research scientist with the IU Network Science Institute at the time of the study. "Bots prey upon this trust by making messages seem so popular that real people are tricked into spreading their messages for them."

Information sources labeled as low-credibility in the study were identified based upon their appearance on lists produced by independent third-party organizations of outlets that regularly share false or misleading information. These sources—such as websites with misleading names like ""—include outlets with both right- and left-leaning points of view.

The researchers also identified other tactics for spreading misinformation with Twitter bots. These included amplifying a single tweet—potentially controlled by a human operator—across hundreds of automated retweets; repeating links in recurring posts; and targeting highly influential accounts.

For instance, the study cites a case in which a single account mentioned @realDonaldTrump in 19 separate messages about millions of illegal immigrants casting votes in the —a false claim that was also a major administration talking point.

The researchers also ran an experiment inside a simulated version of Twitter and found that the deletion of 10 percent of the accounts in the system—based on their likelihood to be bots—resulted in a major drop in the number of stories from low-credibility sources in the .

"This experiment suggests that the elimination of bots from social networks would significantly reduce the amount of misinformation on these networks," Menczer said.

The study also suggests steps companies could take to slow misinformation spread on their networks. These include improving algorithms to automatically detect bots and requiring a "human in the loop" to reduce automated messages in the system. For example, users might be required to complete a CAPTCHA to send a message.

Although their analysis focused on Twitter, the study's authors added that other social networks are also vulnerable to manipulation. For example, platforms such as Snapchat and WhatsApp may struggle to control misinformation on their networks because their use of encryption and destructible messages complicates the ability to study how their users share information.

"As people across the globe increasingly turn to social networks as their primary source of news and information, the fight against requires a grounded assessment of the relative impact of the different ways in which it spreads," Menczer said. "This work confirms that bots play a role in the problem—and suggests their reduction might improve the situation."

To explore election currently shared on Twitter, Menczer's research group has also recently launched a tool to measure "Bot Electioneering Volume." Created by IU Ph.D. students, the program displays the level of bot activity around specific election-related conversations, as well as the topics, user names and hashtags they're currently pushing.

Explore further

What's trending in fake news? Tools show which stories go viral, and if 'bots' are to blame

More information: Chengcheng Shao et al, The spread of low-credibility content by social bots, Nature Communications (2018). DOI: 10.1038/s41467-018-06930-7
Journal information: Nature Communications

Provided by Indiana University
Citation: Twitter bots had 'disproportionate' role spreading misinformation in 2016 election: study (2018, November 20) retrieved 14 October 2019 from
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

Feedback to editors

User comments

Nov 20, 2018
It that is disinformation, how many millions of illegal immigrants did really vote? What is the correct number?

Nov 21, 2018
Illegal voting is vanishingly rare, something like 85 cases total nationwide? Republicans hyperventilate about it due to Demographic Winter and their inability to attract most Millennials.

Nov 21, 2018
"how many millions of illegal immigrants did really vote?" - Puzzled


Trump set one of his ignorant flunkies out to find just such a thing, after this ignorant flunkey insisted that there were millions engaged in voter fraud.

He found nothing.

Nov 26, 2018
well puzzled, by my kinfolk's standards? You are one of those illegal immigrants who fraudulently voted, Your whining reveals that you are one of [imp putin's whores!

Nov 26, 2018
Good to see it quantified. The most interesting result is that identifying and banning the 'bots early seems to be a key to preventing the spread of these memes.

Nov 26, 2018
This comment has been removed by a moderator.

Nov 26, 2018
It has to be recognized that both Twitter and Facebook were major tools in the massive disinformation and propaganda machine used against Democrats by the Russian government in 2016. Similarly, BREXIT was also a Russian influence operation to break the EU apart.

At least seeing it in documented can help free societies beat back this brainwash crap that stifles the planet from constructive actions.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more