Counting every person on Earth to eradicate poverty and empower women

September 29, 2017 by Kenji Takeda, Microsoft

The number one United Nations Sustainable Development Goal is to eliminate poverty, leaving nobody behind. Researchers in the United Kingdom are harnessing the large-scale data-processing power of Microsoft Azure to map the location of every person on Earth to provide the accurate population statistics needed to achieve this international humanitarian goal.

"There are about 2 billion people in the world today who are so poor that they earn less every day than the price of a cappuccino," explains Claire Melamed, Executive Director of The Global Partnership for Sustainable Development Data.

For decades, poverty has been the premier predictor of the general health and economic development needs of the world's most vulnerable populations. Conventional means of assessing poverty, such as national census and household survey data, cannot provide the necessary detailed situational views in a timely manner for aid providers to be fully effective. In 2012, for example, one of the world's largest foundations funded the distribution of polio vaccines in northern Nigeria using 2006 census data. Workers either ran out of vaccines or returned with unused supplies due to the lack of more detailed population information.

The WorldPop research team at the University of Southampton, U.K., provides critical data for tracking the UN Sustainable Development Goals by counting every person on Earth, where they are and who they are. The team does this using novel data science techniques and cloud computing to combine large datasets drawn from census, surveys, satellite, GIS and other sources to provide governments and NGOs with extremely detailed spatial and temporal mappings—some with resolutions down to 100 meters square. "The datasets can be so large and complex that it's impractical or impossible to build them on a single workstation," says Andy Tatem, a professor of geography and environment at the University of Southampton and the director of the WorldPop initiative. "But now our researchers are able to cut them down to size with the compute clusters and parallel computing that Microsoft Azure provides."

For example, consider WorldPop researcher Maksym Bondarenko. He is working on an ambitious global analysis project to draw a range of insightful predictions and calculations from geospatial data for every country in the world at a resolution of 100 square meters, which involves processing 800 million cells of data. Bondarenko built a high-performance computing (HPC) cluster on Azure, using A8-A9 virtual machines that support ultrafast InfiniBand network connections. This high-performance networking is used in many supercomputers, and is necessary to scale beyond a few machines.

"Azure was the only cloud that gave us true supercomputing performance," says Tatem.

Credit: Microsoft Research Blog

The team does much of their analysis using the R programming language, and Microsoft's open source capabilities are ideal for this. "With Azure HDInsight, we also used open source R programming with Microsoft R Server for hosting and managing parallel and distributed workloads of R processes on the VMs," Bondarenko says. "We then output our results to a Random Forest tree-based machine learning model. This approach can enable predictive models and map nonlinear relationships quite well."

Using Azure, WorldPop Research Fellow Jessica Steele has the computing power she needs to analyze how poverty and gender inequality are related to how people live and move. "Poverty is absolutely gendered," she says. "We know women are more likely to be poor and more susceptible to falling into poverty."

Azure is helping Steele achieve more when analyzing large population datasets. "Running statistical models of poverty is a very iterative process. Being able to parallelize and speed up the process using Azure makes that iteration process shorter. This lets us get results back faster, talk to team members more quickly, and make decisions about how to move forward," she says.

WorldPop Research Fellow Dr. Chigozie Edson Utazi provides another example of how Azure helps facilitate the organization's research projects: he uses the cloud computer infrastructure to seamlessly scale his R analysis that provides data for measles vaccination programs in Africa.

"I grew up in Nigeria, and it's amazing that I can sit here help improve the lives of people in my country with this research," he says. "I use R for all my statistical analysis. These datasets cover entire countries sometimes. And you could have millions of grid cells in just one of them. The data is too big, and my computer doesn't have enough memory to handle it. So I would require a bigger computer, a high-performance computer, to be able to do that. It would be nightmarish to do this without Azure. So it's refreshing to use Azure because I don't have to wait in a queue, and I get my code run very quickly, and I have some results back in a very timely manner."

Easy, anywhere access to the Microsoft Azure cloud computing platform, combined with its power, versatility and scalability, has changed how the WorldPop research team does their spatial and temporal mapping research.

"At WorldPop, we're shaving as much as 90 percent off our calculation run-times using Microsoft Azure," Tatem says. "This frees us to focus more on data science, to improve the quality of our population mapping and ultimately to help governments and aid providers target issues more efficiently and effectively."

Explore further: Microsoft, Adobe build on cloud partnership

Related Stories

Microsoft, Adobe build on cloud partnership

April 10, 2017

Microsoft and Adobe are integrating some aspects of their sales and marketing software, building on the cloud-computing partnership the two companies announced last fall.

Microsoft lapse cause outages in Azure service

February 23, 2013

Microsoft unwittingly let an online security certificate expire Friday, triggering a worldwide outage in an online service that stores data for a wide range of business customers.

Microsoft acquires Italian firm in IoT push

May 3, 2016

Microsoft on Tuesday announced it has bought an Italian firm specializing in connecting smart objects in the Internet of Things (IoT), continuing its push into cloud computing.

Cloud computing helps make sense of cloud forests

December 17, 2014

The forests that surround Campos do Jordao are among the foggiest places on Earth. With a canopy shrouded in mist much of time, these are the renowned cloud forests of the Brazilian state of São Paulo. It is here that researchers ...

Microsoft teams with Bank of America on 'blockchain'

September 27, 2016

Microsoft and Bank of America Merrill Lynch on Tuesday announced they are working together to make financial transactions more efficient with blockchain technology—the foundation of bitcoin digital currency.

Recommended for you

Coffee-based colloids for direct solar absorption

March 22, 2019

Solar energy is one of the most promising resources to help reduce fossil fuel consumption and mitigate greenhouse gas emissions to power a sustainable future. Devices presently in use to convert solar energy into thermal ...

EPA adviser is promoting harmful ideas, scientists say

March 22, 2019

The Trump administration's reliance on industry-funded environmental specialists is again coming under fire, this time by researchers who say that Louis Anthony "Tony" Cox Jr., who leads a key Environmental Protection Agency ...

1 comment

Adjust slider to filter visible comments by rank

Display comments: newest first

not rated yet Oct 01, 2017
You don't need to count poor people in order to eliminate poverty. All you need to do is raise the equality of opportunity their society provides for them, by the better sharing of natural resources. Anybody who withholds too much resource should pay a tax and this can act as a leveler for opportunity, particularly for access the land. TAX LAND NOT LABOR;TAX TAKINGS NOT MAKINGS!

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.