Online game aims to improve scientific peer review accuracy

Peer review of scientific research is an essential component of research publication, the awarding of grants, and academic promotion. Reviewers are often anonymous. However, a new study by researchers at the Johns Hopkins Bloomberg School of Public Health found that greater cooperation between reviewer and author can improve accuracy of the review. Their study is published in the Nov. 9 edition of the journal PLoS ONE.

To examine the accuracy of different review processes, the Johns Hopkins researchers developed a model using an online game on the Amazon E2 cloud. Participants were asked to solve and review questions from the GRE (Graduate Record Examinations). The study examined both closed review, in which the author did not know the , and open review, where the author knows the reviewers.

The study found that when review behavior was public and under open review, cooperative interactions increased 13 percent. Overall accuracy between closed and open review models was similar. However, reviewers and authors who participated in cooperative interactions had an 11 percent higher reviewing accuracy rate.

"Our results suggest that increasing cooperation in the process could reduce the risk of reviewing errors," said Jeffrey Leek, PhD, lead author of the study and assistant professor in the Bloomberg School's Department of Biostatistics.


Explore further

Federal peer review may be overstretched and error prone

More information: Leek JT, Taub MA, Pineda FJ (2011) Cooperation between Referees and Authors Increases Peer Review Accuracy. PLoS ONE 6(11): e26895. doi:10.1371/journal.pone.0026895
Journal information: PLoS ONE

Citation: Online game aims to improve scientific peer review accuracy (2011, November 9) retrieved 21 August 2019 from https://phys.org/news/2011-11-online-game-aims-scientific-peer.html
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.
0 shares

Feedback to editors

User comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more