Social and psychological experiments 'a waste of money'?

June 3, 2013, Oxford University
Social and psychological experiments ‘a waste of money'?

( —A study suggests that money will continue to be wasted on research into social and psychological interventions unless the methods used by the researchers are fully reported in academic journals.

Researchers from Oxford University and UCL (University College London) reviewed over 200 experiments across 40 of the leading journals in social and (covering , criminology, education, and social work). They conclude that is being wasted because the reports are not carrying full details about how the interventions were implemented. Without the 'missing details', it is difficult for policymakers and practitioners to put the interventions into practice despite the amounts of money being invested in high-, says the study published in the current issue of the journal PLOS ONE.

The study, which was supported by the Economic and Social Research Council (ESRC), suggests that reporting guidelines have improved the quality of trial reports in medicine. Yet those existing guidelines may not be suitable for social and psychological intervention trials. The study argues that a higher quality of reporting would give policymakers and practitioners the guidance they need on what groups might benefit from interventions. Details about the study methods would also indicate whether the results of an experiment are biased, says the research.

Paul Montgomery, Professor of Psycho-Social Interventions at the University of Oxford, said: 'In this era of austerity, policymakers increasingly look for evidence of "what works" to ensure that revenue is well-spent on programmes that address issues such as poverty, mental health, crime, and drug use. Evaluations of these programmes can be expensive. When they are reported fully and transparently, they can help policymakers choose the most effective way to spend public funds; however, readers rely on reports of these studies in to effectively understand and use the research. Reporting guidelines are a critical step in improving this area of research for policy decision-making.'

In response, the study authors are leading a global effort to develop reporting standards for social and psychological experiments, building on existing guidelines used in medicine and other disciplines. The goal is for scientists who are involved in experiments of complex interventions follow a common set of guidelines that identifies the essential information required to understand all experiments, including disciplines outside of medicine.

The research team hopes scientists, journal editors, , and other interested groups will contribute to the discussion. Participants can give their views by using an online form on the Social Policy and Intervention website under the CONSORT project (Consolidated Standards of Reporting Trials).

Dr Evan Mayo-Wilson, Senior Researcher in Psychology at UCL, said: 'There are many excellent experiments that identify ways to improve social and psychological care. Too often, these studies cannot be used because published reports are missing critical details. Social and psychological research should help us change people's lives. To do that, the scientific record needs to be both accurate and complete. We are thrilled that so many researchers and journal editors have joined this project. Through collective effort, we hope this problem can be solved in a few years.'

Explore further: New guidance urges improved reporting of important outcomes for patients in trials publications

More information: … journal.pone.0065442

Related Stories

Smoking prevention in schools: Does it work?

April 29, 2013

Smoking prevention in schools reduces the number of young people who will later become smokers, according to a new systematic review published in The Cochrane Library. For young people who have never smoked, these programmes ...

Intervention to improve colon cancer screening ineffective

May 29, 2013

(HealthDay)—An intervention designed to improve colon cancer screening rates in primary care practices has failed to have a significant impact on screening, according to a study published in the May/June issue of the Annals ...

Recommended for you

Study sheds new light on ancient human-turkey relationship

January 17, 2018

For the first time, research has uncovered the origins of the earliest domestic turkeys in ancient Mexico. The study also suggests turkeys weren't only prized for their meat—with demand for the birds soaring with the Mayans ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.