Surveying African cities using Twitter

Apr 30, 2014 by Jan Overney
Surveying African cities using twitter

Researchers are using Tweets to monitor the vital statistics of African cities. A first case study zooms in on the capital of Kenya, Nairobi.

Ask the local authorities how many people live in the city of Lausanne, Tokyo, or San Francisco, and they will offer up a relatively accurate number. Ask the same question in Kinshasa or Dar es Salaam, and they will be left guessing. Especially in the continent's less developed countries, African cities are statistically opaque, lacking quantitative information on measures as simple as and population counts. Now, researchers working with EPFL's Afrotech Future Africa Initiative are turning to Twitter, the online messaging service, as a free and powerful tool to fill some of these gaps.

Their first study focuses on the Kenyan capital, Nairobi, a city with a diverse population of just over 3 million inhabitants, and seeks to develop ways to make sense of the data generated by Twitter users. "While each individual message, each Tweet, may contain only trivialities, analyzed in large numbers, they can reveal potentially interesting information," says Darshan Santani, a doctoral student at EPFL and Idiap in Switzerland. Santani set up a website that visualizes geo-localized sent from Nairobi, Kenya.

On the screen, Tweets collected over a three-month period appear as dark red dots, densely lining the main roads that lead into Nairobi and the city center. Word clouds present the most frequently used words at various locations on the map, showing how the use of social media varies across the city. To extract valid information from the Tweets, they have to be analyzed in their sociological and geographic context.

This video is not supported by your browser at this time.

The website presents about a dozen observations, interpretations of the data, made based on the content of the messages. "Tweeting does not mean production," says one, demonstrating that Tweets and economic activity do not go hand in hand. The data show that more Tweets leave golf clubs and upscale cafés than the economically productive industrial area. "Tweeting means money," says a second observation, highlighting one of the major challenges the researchers face: Tweets do not represent the entire population, as they are sent only by the middle and upper class. This is particularly obvious in informal settlements, where Tweets are typically sent by aid-workers.

For each new city they study, the researchers will form partnerships with local universities to help meaningfully interpret the data. A first collaboration is planned for this summer with IBM Research Africa in Nairobi. And as the number of collaborating institutions in Africa grows, so too should the number of collaborating labs at EPFL. "We are setting up the MIRROR group, a consortium of labs interested in interrogating large African datasets," says director of Afrotech Jonathan Ledgard. "Our goal is to get all the labs on board whose work would be advanced by having access to this and other data sources, for example, to better understand the spread of infectious diseases or how a city's limits evolve over time."

The long-term objectives of the project go well beyond its current urban focus, and will include other sources of data. "More data will be produced in Africa in the coming years than in recorded history," says Ledgard. This, he says, will have a transformative effect across the continent, as long as methods to effectively mine these data are able to keep up with their generation. By providing access to these datasets and developing the methodologies needed to interrogate them, collaborative projects set up by the MIRROR group will contribute to making the most of this historic moment.

Explore further: Twitter study shows Africa is football mad

add to favorites email to friend print save as pdf

Related Stories

Twitter study shows Africa is football mad

Mar 12, 2014

Posts about football topped Africans' tweets last year, trumping even world events like the death of Nelson Mandela, results from a study released on Wednesday showed.

Research: South Africans most active tweeters

Jan 26, 2012

Young people tweeting from BlackBerrys and iPhones are driving the growth of Twitter in Africa, with South Africans by far the most vociferous, according to new research published Thursday.

Recommended for you

Forging a photo is easy, but how do you spot a fake?

Nov 21, 2014

Faking photographs is not a new phenomenon. The Cottingley Fairies seemed convincing to some in 1917, just as the images recently broadcast on Russian television, purporting to be satellite images showin ...

Algorithm, not live committee, performs author ranking

Nov 21, 2014

Thousands of authors' works enter the public domain each year, but only a small number of them end up being widely available. So how to choose the ones taking center-stage? And how well can a machine-learning ...

Professor proposes alternative to 'Turing Test'

Nov 19, 2014

(Phys.org) —A Georgia Tech professor is offering an alternative to the celebrated "Turing Test" to determine whether a machine or computer program exhibits human-level intelligence. The Turing Test - originally ...

Image descriptions from computers show gains

Nov 18, 2014

"Man in black shirt is playing guitar." "Man in blue wetsuit is surfing on wave." "Black and white dog jumps over bar." The picture captions were not written by humans but through software capable of accurately ...

Converting data into knowledge

Nov 17, 2014

When a movie-streaming service recommends a new film you might like, sometimes that recommendation becomes a new favorite; other times, the computer's suggestion really misses the mark. Yisong Yue, assistant ...

User comments : 0

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.