'Culturomics 2.0' forecasts human behavior by supercomputing global news

September 6, 2011

A paper published yesterday in the peer-reviewed journal First Monday combines advanced supercomputing with a quarter-century of worldwide news to forecast and visualize human behavior, from civil unrest to the movement of individuals.

The paper, titled "Culturomics 2.0: Forecasting Large-Scale Using Global Tone in Time and Space," uses the tone and location of news coverage from across the world to forecast country stability (including retroactively predicting the recent Arab Spring), estimate Osama Bin Laden's final location as a 200-kilometer radius around Abbottabad, and uncover the six world civilizations of the media. The research also demonstrates that the news is indeed becoming more negative and even visualizes global human societal conflict and cooperation over the last quarter century.

Using the large shared-memory supercomputer Nautilus, Kalev Leetaru of the University of Illinois in Urbana-Champaign combined three massive news archives totaling more than 100 million articles worldwide to explore the global consciousness of the news media. The complete New York Times from 1945 to 2005, the unclassified edition of Summary of World Broadcasts from 1979 to 2010, and an archive of English-language News articles spanning 2006 to 2011 were used to capture a cross-section of the U.S. media spanning half a century and the global media over a quarter-century.

Advanced tonal, geographic, and network analysis methods were used to produce a network 2.4 petabytes in size containing more than 10 billion people, places, things, and activities connected by over 100 trillion relationships, capturing a cross-section of Earth from the news media. A subset of findings from this analysis were then reproduced for this study using more traditional methods and smaller-scale workflows that offer a model for a new class of research that explores how the world views itself.

Explore further: Neglected tropical diseases rarely make the headlines

More information: Read more about results from this research in the full paper at www.uic.edu/htbin/cgiwrap/bin/ojs/index.php/fm/article/view/3663/3040

Related Stories

Neglected tropical diseases rarely make the headlines

May 14, 2008

A new study of leading news organizations has found that neglected tropical diseases (NTDs) rarely make headlines, despite the huge amount of illness, suffering, and poverty that they cause. The study is published May 14th ...

Scientists map what factors influence the news agenda

December 8, 2010

Computer scientists have analysed over a million news articles in 22 languages to pinpoint what factors, such as the Eurovision song contest, influence and shape the news agenda in 27 EU countries. This is the first large-scale ...

Study asks 'Are foreign correspondents redundant?'

December 9, 2010

Economic pressures and digital technology are undermining the role of the foreign correspondent, according to a new Oxford University study. Among its recommendations, it says news organizations need to ‘rethink their ...

Gartner forecasts 5.6% rise in IT spending

March 30, 2011

Worldwide information technology spending is expected to rise 5.6 percent this year with tablet computers like Apple's iPad helping to drive growth, a technology research company said Wednesday.

Recommended for you

Tech leaders warn over 'killer robots' (Update)

July 28, 2015

A group of top tech leaders, including British scientist Stephen Hawking and Apple co-founder Steve Wozniak, on Tuesday issued a stern warning against the development of so-called killer robots.

Cellphones can steal data from 'air-gapped computers'

July 28, 2015

Researchers at the Ben-Gurion University of the Negev (BGU) Cyber Security Research Center have discovered that virtually any cellphone infected with a malicious code can use GSM phone frequencies to steal critical information ...

2 comments

Adjust slider to filter visible comments by rank

Display comments: newest first

bottomlesssoul
not rated yet Sep 06, 2011
"(including retroactively predicting the recent Arab Spring)" - ??? Funny that, a mouse living in my garage predicted it as well.
Justsayin
1 / 5 (1) Sep 26, 2011
This smells like something the CIA would construct or fund not a University. jmho

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.