Social and psychological experiments 'a waste of money'?

Jun 03, 2013
Social and psychological experiments ‘a waste of money'?

( —A study suggests that money will continue to be wasted on research into social and psychological interventions unless the methods used by the researchers are fully reported in academic journals.

Researchers from Oxford University and UCL (University College London) reviewed over 200 experiments across 40 of the leading journals in social and (covering , criminology, education, and social work). They conclude that is being wasted because the reports are not carrying full details about how the interventions were implemented. Without the 'missing details', it is difficult for policymakers and practitioners to put the interventions into practice despite the amounts of money being invested in high-, says the study published in the current issue of the journal PLOS ONE.

The study, which was supported by the Economic and Social Research Council (ESRC), suggests that reporting guidelines have improved the quality of trial reports in medicine. Yet those existing guidelines may not be suitable for social and psychological intervention trials. The study argues that a higher quality of reporting would give policymakers and practitioners the guidance they need on what groups might benefit from interventions. Details about the study methods would also indicate whether the results of an experiment are biased, says the research.

Paul Montgomery, Professor of Psycho-Social Interventions at the University of Oxford, said: 'In this era of austerity, policymakers increasingly look for evidence of "what works" to ensure that revenue is well-spent on programmes that address issues such as poverty, mental health, crime, and drug use. Evaluations of these programmes can be expensive. When they are reported fully and transparently, they can help policymakers choose the most effective way to spend public funds; however, readers rely on reports of these studies in to effectively understand and use the research. Reporting guidelines are a critical step in improving this area of research for policy decision-making.'

In response, the study authors are leading a global effort to develop reporting standards for social and psychological experiments, building on existing guidelines used in medicine and other disciplines. The goal is for scientists who are involved in experiments of complex interventions follow a common set of guidelines that identifies the essential information required to understand all experiments, including disciplines outside of medicine.

The research team hopes scientists, journal editors, , and other interested groups will contribute to the discussion. Participants can give their views by using an online form on the Social Policy and Intervention website under the CONSORT project (Consolidated Standards of Reporting Trials).

Dr Evan Mayo-Wilson, Senior Researcher in Psychology at UCL, said: 'There are many excellent experiments that identify ways to improve social and psychological care. Too often, these studies cannot be used because published reports are missing critical details. Social and psychological research should help us change people's lives. To do that, the scientific record needs to be both accurate and complete. We are thrilled that so many researchers and journal editors have joined this project. Through collective effort, we hope this problem can be solved in a few years.'

Explore further: How well does technology solve social problems?

More information:

Related Stories

Smoking prevention in schools: Does it work?

Apr 29, 2013

Smoking prevention in schools reduces the number of young people who will later become smokers, according to a new systematic review published in The Cochrane Library. For young people who have never smoked, these progra ...

Recommended for you

How well does technology solve social problems?

43 minutes ago

University of Michigan professor Kentaro Toyama was in India leading a team studying how to make computers work better in the classroom when he noticed that students far outnumbered computers at the underfunded ...

UN: Fewer hungry people in the world despite wars, poverty

20 hours ago

The number of hungry people around the world has dropped to 795 million from over a billion a quarter-century ago despite natural disasters, ongoing conflicts and poverty, the three U.N. food agencies said Wednesday.

User comments : 0

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.