Blockchain can strengthen the credibility of meta-analyses

Credit: CC0 Public Domain

When it comes to accumulating and assessing research evidence, meta-analyses are considered the gold standard as they allow researchers to analyze results from many studies on the same question. It is sometimes the case, however, that two meta-analyses on the same question, both pointing to hundreds of studies to back them up, draw completely opposite conclusions. The debates on whether or not video games cause violent behavior is one prominent example.

Meta-analyses often arrive to very different conclusions because in the process of conducting them, researchers make many conscious and unconscious choices that can affect the end result. Documenting all of these decisions can be overly cumbersome, but without this information, it's difficult to accurately judge the credibility of a meta-analysis.

Kweku Opoku-Agyemang, a Research Fellow at the Center for Effective Global Action at the University of California, Berkeley, believes that , with its ability to create tamper-proof, time-stamped records of events, can strengthen the transparency and reproducibility of meta-analyses.

At the 2019 American Association for the Advancement of Science Annual Meetings, he will present his idea of how blockchain can be applied to social science meta-analyses, where reproducibility is a growing concern. Opoku-Agyemang looks to build a cloud computing platform that would continuously record a researcher's workflow and track analysts' decisions, such as how studies are collected and analyzed as part of a meta-analysis. In cases where meta-analyses present contradictory results on the same question, blockchain can help pinpoint exactly how they vary based upon individual timestamps of analytic decisions. The proposed platform would seamlessly create dependable records without adding to the already difficult process of conducting a meta-analysis.

"My hope is that blockchain can not only make meta-analysis research more efficient, but inspire new lines of research to help solve the many economic and we all care about" says Opoku-Agyemang. "I also hope that it will facilitate collaboration, as the social sciences in general, and economics in particular, are still lagging behind other disciplines." In the next step of the project, Opoku-Agyemang is looking to pilot his concept using the literature on microcredit, which is an increasingly popular poverty alleviation tool among policymakers, but one that is heavily contested in the research community.

Explore further

Researchers call for new consistent, robust standards for the development of meta-analyses

Citation: Blockchain can strengthen the credibility of meta-analyses (2019, February 14) retrieved 16 July 2019 from
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

Feedback to editors

User comments

Feb 14, 2019
Replicating scientific studies in areas like psychology or medicine is difficult because people lie a lot, and they have private agendas that they want to push forward no matter what are the consequences for others. Usually they are paid by big political groups, or other large organizations that want the research to influence political or financial outcomes. Blockchain will not make people to be honest about their studies, blockchain only creates a secure recording of the data. For example, someone working for a pharmaceutical company can collect dirty data trying to do a smear campaign on the competence. Blockchain technology would allow that person to record his bad intentions in a secure manner.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more