Surveying African cities using Twitter

April 30, 2014 by Jan Overney
Surveying African cities using twitter

Researchers are using Tweets to monitor the vital statistics of African cities. A first case study zooms in on the capital of Kenya, Nairobi.

Ask the local authorities how many people live in the city of Lausanne, Tokyo, or San Francisco, and they will offer up a relatively accurate number. Ask the same question in Kinshasa or Dar es Salaam, and they will be left guessing. Especially in the continent's less developed countries, African cities are statistically opaque, lacking quantitative information on measures as simple as and population counts. Now, researchers working with EPFL's Afrotech Future Africa Initiative are turning to Twitter, the online messaging service, as a free and powerful tool to fill some of these gaps.

Their first study focuses on the Kenyan capital, Nairobi, a city with a diverse population of just over 3 million inhabitants, and seeks to develop ways to make sense of the data generated by Twitter users. "While each individual message, each Tweet, may contain only trivialities, analyzed in large numbers, they can reveal potentially interesting information," says Darshan Santani, a doctoral student at EPFL and Idiap in Switzerland. Santani set up a website that visualizes geo-localized sent from Nairobi, Kenya.

On the screen, Tweets collected over a three-month period appear as dark red dots, densely lining the main roads that lead into Nairobi and the city center. Word clouds present the most frequently used words at various locations on the map, showing how the use of social media varies across the city. To extract valid information from the Tweets, they have to be analyzed in their sociological and geographic context.

The video will load shortly

The website presents about a dozen observations, interpretations of the data, made based on the content of the messages. "Tweeting does not mean production," says one, demonstrating that Tweets and economic activity do not go hand in hand. The data show that more Tweets leave golf clubs and upscale cafés than the economically productive industrial area. "Tweeting means money," says a second observation, highlighting one of the major challenges the researchers face: Tweets do not represent the entire population, as they are sent only by the middle and upper class. This is particularly obvious in informal settlements, where Tweets are typically sent by aid-workers.

For each new city they study, the researchers will form partnerships with local universities to help meaningfully interpret the data. A first collaboration is planned for this summer with IBM Research Africa in Nairobi. And as the number of collaborating institutions in Africa grows, so too should the number of collaborating labs at EPFL. "We are setting up the MIRROR group, a consortium of labs interested in interrogating large African datasets," says director of Afrotech Jonathan Ledgard. "Our goal is to get all the labs on board whose work would be advanced by having access to this and other data sources, for example, to better understand the spread of infectious diseases or how a city's limits evolve over time."

The long-term objectives of the project go well beyond its current urban focus, and will include other sources of data. "More data will be produced in Africa in the coming years than in recorded history," says Ledgard. This, he says, will have a transformative effect across the continent, as long as methods to effectively mine these data are able to keep up with their generation. By providing access to these datasets and developing the methodologies needed to interrogate them, collaborative projects set up by the MIRROR group will contribute to making the most of this historic moment.

Explore further: Research: South Africans most active tweeters

Related Stories

Research: South Africans most active tweeters

January 26, 2012

Young people tweeting from BlackBerrys and iPhones are driving the growth of Twitter in Africa, with South Africans by far the most vociferous, according to new research published Thursday.

Twitter study shows Africa is football mad

March 12, 2014

Posts about football topped Africans' tweets last year, trumping even world events like the death of Nelson Mandela, results from a study released on Wednesday showed.

Recommended for you

Riddle of cement's structure is finally solved

February 9, 2016

Concrete is the world's most widely used construction material, so abundant that its production is one of the leading sources of greenhouse gas emissions. Yet answers to some fundamental questions about the microscopic structure ...

Tiny diatoms boast enormous strength

February 8, 2016

Diatoms are single-celled algae organisms, around 30 to 100 millionths of a meter in diameter, that are ubiquitous throughout the oceans. These creatures are encased within a hard shell shaped like a wide, flattened cylinder—like ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.