Wisdom of crowds

Aug 25, 2011
A village in rural Indonesia. A new study by MIT researchers suggests local residents make accurate judgments of their neighbors’ poverty levels. Image: flickr/p2-r2

In countries that lack financial records, how can we tell who is truly poor? An innovative study suggests: Ask the neighbors.

In , anti-poverty programs face a basic hurdle: Who, exactly, is poor enough to qualify for the aid being given out? Emerging states often lack the official records, such as income and tax documents, that are used to make those judgments in wealthier countries.

Now, a novel study co-authored by two MIT has identified a surprisingly effective way of deciding who, in the , is especially poor: Let the sit down and decide among themselves.

The study, done by Abhijit Banerjee and Benjamin Olken of MIT’s Department of Economics along with three colleagues at other institutions, is based on fieldwork conducted in 640 Indonesian villages. Indonesia, like many other developing countries, lacks the comprehensive data needed for means testing; that is, it cannot create objective measures of personal wealth to indicate which citizens need aid most badly.

There are two striking results in the new paper, to be published in the American Economic Review later this year. First, when citizens are asked to make collective about the relative wealth of their , the outcomes are very close to those produced by objective measures. Second, citizens are far more satisfied by the results when they are consulted than when they are left out of the process.

In theory, that means governments such as Indonesia’s could use the knowledge of local residents to help them distribute aid, while enhancing the state’s legitimacy in the eyes of its citizens.

“It might be easier than we thought to hand over this whole process to the communities,” says Banerjee, the Ford International Professor of Economics and a co-founder of MIT’s Abdul Latif Jameel Poverty Action Lab (J-PAL).

“I think there’s a much bigger role for community-based targeting of these programs than people would have expected,” adds Olken, an associate professor of economics.

Power to the people

The field experiment, conducted in collaboration with the Indonesian government and the World Bank, offered a small amount of cash to households deemed below the poverty line. In one-third of the villages, the government used a proxy means test involving household assets to create an objective measure of wealth. Another third of the villages used the “community method,” as the researchers call it: With the assistance of facilitators from the research project, citizens from certain neighborhoods would gather at meetings and subjectively rank the wealth of the local inhabitants. The final third of the villages employed a hybrid of both methods.

The economists also used a research firm to survey all the citizens about their spending habits. Using this spending data as a baseline for wealth, the results show that the proxy means test is the best method for estimating wealth — but only by a slim margin.

On the other hand, the community method led to 60 percent fewer complaints among villagers about the results of the programs, compared to the proxy means test.  

“People are much happier with the list generated by the community method,” Olken says.  “The proxy means test does a slightly better job of assessing the objective things, but the community method does much better job of matching people’s own individual self-assessment of who is poorer or wealthier, and thus generates higher satisfaction.”

Explaining how the villagers’ assessment of poverty differs from the means test is hard, but the survey data contain some clues. Widows, for instance, tend to be considered poorer than the means tests indicate; so are households with a relatively larger portion of children. People with lower education levels also tend to be considered poorer.

Policy upshot: Is it worth the tradeoff?

The policy implications of the study seem clear: In exchange for a slightly less effective method of determining who needs the most help, governments can gain significant amounts of credibility by empowering local citizens to help distribute aid. In a country such as Indonesia, which has made a transition toward democracy since the ouster of its former president, Suharto, in 1998, matters of public credibility are highly significant.

“The question of legitimacy always comes up whenever you have somebody from outside deciding who’s poor,” Banerjee says. “Here, even the attempt to produce modest checks and balances made people much less happy.” Moreover, Olken says, village leaders often “don’t want to be in the business of picking winners and losers.”

On the other hand, as Olken notes, Indonesia’s president, Susilo Bambang Yudhoyono, promised to reduce poverty levels during his 2009 re-election campaign, and the government may feel that the extra bit of accuracy deriving from means testing is worth pursuing.

Olken says the researchers found no evidence of “elite capture,” the attempt by local leaders to manipulate the rankings for the benefit of their own relatives or political allies. However, the research team is studying the results of a follow-up experiment to see if the problem occurs when larger aid grants are at stake.

The absence of elite capture caught the eye of other development economists, including Tim Besley, Kuwait Professor of Economics and Political Science at the London School of Economics, who calls the work “a very nice and persuasive study” in the field.

“When you decentralize anti-poverty programs on the ground, the idea that elites will use that for capturing a program is a big policymaker’s concern,” Besley says. “Therefore, evidence that tells us this is not happening in particular contexts is enormously useful.”

The study, Besley thinks, could encourage similar research and policy analysis in other countries, although any future results might well differ from those found in Indonesia. “It’s very difficult to take a country-specific study and then say it applies somewhere else,” he notes. “But … having a well-done and interesting study like this will, without question, get policymakers discussing the issues … and I think the knowledge base evolves in that way.”

Besides Banerjee and Olken, the authors of the paper, “Targeting the Poor: Evidence from a Field Experiment in Indonesia,” are Vivi Alatas of the World Bank; Rema Hanna of Harvard University’s Kennedy School of Government; and Julia Tobias of the National Team for the Acceleration of Poverty Reduction in Indonesia.

Financial support for the project came from a World Bank – Royal Netherlands Embassy trust fund.


This story is republished courtesy of MIT News (web.mit.edu/newsoffice/), a popular site that covers news about MIT research, innovation and teaching.

Explore further: Report shows there is space for at least 1 million new homes on brownfield sites in England

add to favorites email to friend print save as pdf

Related Stories

Life on a dollar a day

Apr 26, 2011

Imagine, for a moment, that you must live on 99 cents per day. How would you manage it? For roughly 850 million people around the globe, this is not a hypothetical question; those people really have daily ...

Democracy put to the test

Feb 08, 2010

Developing countries that free themselves from authoritarian governments are often called “experiments in democracy.” But what happens when a researcher runs an actual field experiment in democracy? A ...

Study finds sick kids have fewer friends

Dec 07, 2010

A new study reveals that sick teens are more isolated than other kids, but they do not necessarily realize it and often think their friendships are stronger than they actually are.

Education trumps regulation

Aug 05, 2011

A University of Alberta study shows that simply educating farmers about the hazards of pesticides can reduce their chance of usage by nine per cent.

Recommended for you

Study identifies why re-educating torturers may not work

Nov 21, 2014

Many human rights educators assume – incorrectly, as it turns out – that police and military officers in India who support the torture of suspects do so because they are either immoral or ignorant. This ...

User comments : 0

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.