Truthy.indiana.edu to search, identify smear tactics, Twitter-bombs through election runup

Sep 28, 2010
Streaming Twitter data acquired in real-time is matched against keywords to exclude tweets unlikely to contain political discussion and extract memes (mentions, hash tags, and urls). Memes of interest are isolated by considering only those that have just undergone significant changes in volume, or those that account for a significant portion of the total volume. Memes are then inserted in a database and Twitter API is used to obtain more information on each. Credit: Indiana University Center for Complex Networks and Systems Research

Astroturfers, Twitter-bombers and smear campaigners need beware this election season as a group of leading Indiana University information and computer scientists today unleashed Truthy.indiana.edu, a sophisticated new Twitter-based research tool that combines data mining, social network analysis and crowdsourcing to uncover deceptive tactics and misinformation leading up to the Nov. 2 elections.

Combing through thousands of tweets per hour in search of political keywords, the team based out of IU's School of Informatics and Computing will isolate patterns of interest and then insert those memes (ideas or patterns passed by imitation) into Twitter's (API) to obtain more information about the meme's history.

"When we identify a trend we go back and examine how it was started, where the main injection points were, and any associated memes," said Filippo Menczer, an associate professor of computer science and informatics. "When we drill down we'll be able to see statistics and visualizations relating to tweets that mention the meme, and basically reconstruct its history."

The team will then generate diffusion network images that visitors to Truthy.indiana.edu can view as groups of nodes and edges that identify retweets, mentions, and the extent of the epidemic. Visitors to the site will also see the output of a sentiment analysis algorithm that examines and extracts mood-identifying words and then assesses them on a known psychometric scale. That algorithm identifies the meme on scales ranging from anxious to calm, hostile to kind, unsure to sure, and confused to aware.

Menczer got the idea for the Truthy website after hearing researchers from Wellesley College speak earlier this year on their research analyzing a well-known bomb campaign conducted by the conservative group American Future Fund (AFF) against Martha Coakley, a democrat who lost the Massachusetts senatorial seat formerly held by the late Edward Kennedy. Republican challenger Scott Brown won the seat after AFF set up nine Twitter accounts in early morning hours prior to the election and then sent out 929 tweets in two hours before Twitter realized the information was spam. By then the messages had reached 60,000 people.

Menczer explained that because search engines now include Twitter trends in search results, an astroturfing campaign - where the concerted efforts of special interests are disguised as a spontaneous grassroots movement - that includes Twitter bombs can jack up how high a result shows up on Google even if the information is false.

This is one reason Truthy.indiana.edu also relies on input from users to denote a meme as "truthy," or misinformation represented as fact. Having a crowdsourcing component will help the data mining effort and hopefully keep the loop between and search engines honest, researchers said.

Pictured here is a diffusion network created by Truthy.indiana.edu for the Twitter burst generated by Lady Gaga supporters toward John McCain following Gaga's comments about McCain's opposition to repealing Don't Ask, Don't Tell. The meme was tweeted 1,276 times by 1,100 users, with 168 users retweeting 696 times and another 59 users mentioning the meme 325 times. Links in orange are mentions; blue links show retweets. Credit: Indiana University Center for Complex Networks and Systems Research

"One of the concerns about social media is that people are being manipulated without realizing it because a meme can be given instant global popularity by a high search engine ranking, in turn perpetuating the falsehood," Menczer said.

As information scientists, the group is interested in understanding meme diffusion from various perspectives: Menczer, associate director of IU's Center for Complex Networks and Systems Research, focuses on data mining and meme burst modeling; Rudy Professor of Informatics Alessandro Vespignani's work relates to epidemic and contagion modeling; associate professor of informatics Alessandro Flammini, also director of IU's Complex Systems Program, conducts complex network analysis, especially related to online text and social media; and associate professor of informatics and computing Johan Bollen has a background in cognitive science and specializes in sentiment and mood analysis from online text.

The website's name, Truthy, references a "stunt word" first employed by television comedian and political pundit Stephen Colbert in 2005 to satirize the use of emotional appeal as fact.

Explore further: Chameleon: Cloud computing for computer science

Related Stories

Yahoo is Going Portuguese Hound to Outwit Twitter

May 15, 2009

Brazil, a Portuguese speaking country is the 10th largest economy in the world and Yahoo has decided to get in on the action by coming up with a clone Twitter. The economic down-turn has affected Brazil to ...

Most influential tweeters of all

Sep 09, 2010

Tweet this, Ashton Kutcher, Lady Gaga and Britney Spears. Just because you have a ton of followers on Twitter doesn't necessarily mean you're among the most influential people in the Twitterverse, according to researchers ...

The Twit-election: It's the conversation, stupid

Aug 18, 2010

(PhysOrg.com) -- When it comes to Saturday's federal election in Australia, Twitter users are clear: politicians who spend time in conversation get most out of the platform, and the Greens are exploiting this ...

Phishers can use social Web sites as bait to net victims

May 24, 2007

Internet sites such as MySpace and Facebook are popular ways for friends to stay in touch, but they also can be used by cyber sharks posing as "friends," enabling them to steal personal and financial information.

Twitter unveils new frontpage

Jul 30, 2009

Micro-blogging service Twitter has unveiled a new frontpage featuring a prominent search box in a bid to attract new users.

Recommended for you

Chameleon: Cloud computing for computer science

Aug 26, 2014

Cloud computing has changed the way we work, the way we communicate online, even the way we relax at night with a movie. But even as "the cloud" starts to cross over into popular parlance, the full potential ...

User comments : 3

Adjust slider to filter visible comments by rank

Display comments: newest first

ECOnservative
3 / 5 (2) Sep 28, 2010
I wonder how biased the reporting will be? One man's SPAM is another's political discourse..
anonperson
not rated yet Sep 29, 2010
I find it fascinating. It reminds a little bit of Doctorow's Little Brother. How to keep the masses informed with verifiable information... information theorists are scrambling to keep up, I'm sure.
JYK
1 / 5 (1) Sep 29, 2010
I wonder how biased the reporting will be? One man's SPAM is another's political discourse..


The answer to your question is in the article as quoted here:
"Menczer got the idea for the Truthy website after hearing researchers from Wellesley College speak earlier this year on their research analyzing a well-known Twitter bomb campaign conducted by the conservative group American Future Fund (AFF) against Martha Coakley, a democrat who lost the Massachusetts senatorial seat formerly held by the late Edward Kennedy."

This illustrates the bias of the whole program as one would expect from the ultra liberal crowd that has taken over the whole educational system in the US.

George Orwell is spinning in his grave . . .