Transparency in peer review

September 8, 2017 by Phil Hurst
The Duke of Sussex. Credit: The Royal Society

In 1832, the Royal Society moved from using committee minutes to written peer review reports for determining what was published in Philosophical Transactions. This was conveyed by Frederick Augustus, The Duke of Sussex in his Presidential address of November that year.

The reports were written by members of Council and were often made public. They were 'often more valuable than the original communications upon which they are founded'.

The reporting was collaborative and referees were expected to reach a consensus. This was time consuming and could be problematic, especially when referees disagreed. It was therefore abandoned after 1832, and both reports and the names of reviewers were kept confidential.

It wasn't until the dawn of the 21st Century that publishers (such as BMC, BMJ and PLoS) started to seriously experiment with open .

Transparency is back in vogue

Why is this? The first reason is the politicisation of science. A good example is climate change—when scientists from the University of East Anglia were bombarded with freedom of information requests by climate sceptics, it became clear there was a lack of and this was used to undermine the veracity of the research. Policy based on published research is under increased scrutiny.

The second reason stems from the open science and open access agenda. Much research is funded by the public purse and it is argued that the published output from this research should be available to all. It follows that the evidence—data, peer —on which claims are made should be made open too.

Finally, transparency has the potential to improve the quality of research and reduce research misconduct. Traditional peer review is confidential, with research papers scrutinised by a small number of anonymous experts. Although publishers are vigilant, this secrecy provides the opportunity for fraud.

Transparency in peer review
Credit: The Royal Society

In 2014, the Royal Society launched the journal Royal Society Open Science which offers optional open peer review where reports are published along with articles. This has proved popular with the majority of authors opting for publication of peer review reports and half of reviewers signing their reports. The uptake varies by scientific discipline.

Since then, open peer review has been introduced on two further Royal Society journals, Proceedings A and Open Biology.

Benefits of transparency in peer review

There are several benefits to open peer review.

  1. Readers can see the comments by reviewers and reach their own conclusions about the rigour and fairness of the process. They can also see how the authors have responded to the criticism and if any errors or shortcomings in the article have been missed. Readers have more information on which to base any comments they may wish to make after publication. In this way, the published science can be improved.
  2. Reviewers' suggestions to improve the paper are available to everyone as examples of what makes a good review. This is particularly useful for early career scientists who may have limited experience of reviewing articles themselves.
  3. Reviewers tend to write better and more balanced reviews if they know they will be made public.
  4. By signing their reports reviewers can get recognition for this vital contribution to the research process. Peer review recognition services are becoming more common, with examples including Publons and ORCID.

Overall, the whole peer review process gains more trust and accountability when everything is transparent.

Is open peer review just a passing fad (like in 1832)?

Back in 1832, science wasn't ready for transparency – producing detailed written reports for public judgement on the value of a paper was just too much work for the small number of referees, and publicly criticising peers was socially very difficult.

Today, because science is funded largely by the public purse and informs so much public policy, transparency is essential. In recent decades many believe that impact and citations have played far too prominent a role in determining what is published. Transparency is important in helping journals focus on the quality and rigour of the research process rather than its likely impact, originality and even fashion. A vital part of this opening up of peer review is recognising the value of such work as an essential 'output' in assessments for grants and tenure. There is cause for optimism that the abandonment of open peer review in 1832 will not be repeated.

Explore further: Bringing a 'trust but verify' model to journal peer review

Related Stories

Bringing a 'trust but verify' model to journal peer review

July 21, 2017

Academic journals are increasingly asking authors to use transparent reporting practices to "trust, but verify" that outcomes are not being reported in a biased way and to enable other researchers to reproduce the results. ...

Open peer review could result in better quality of peer review

September 29, 2015

Whether or not a research article has been peer reviewed openly can seemingly make a difference to the quality of the peer review, according to research carried out by BioMed Central's Research Integrity Group and Frank Dudbridge ...

Intelligent crowd reviewing of scientific papers tested

June 9, 2017

(Phys.org)—Online chemistry journal Synlett, which is published by Thieme, has tested the idea of intelligent crowd reviewing of scientific papers. The project was the brainchild of Benjamin List, a journal editor (and ...

Online game aims to improve scientific peer review accuracy

November 9, 2011

Peer review of scientific research is an essential component of research publication, the awarding of grants, and academic promotion. Reviewers are often anonymous. However, a new study by researchers at the Johns Hopkins ...

Recommended for you

Ancient DNA offers new view on saber-toothed cats' past

October 19, 2017

Researchers who've analyzed the complete mitochondrial genomes from ancient samples representing two species of saber-toothed cats have a new take on the animals' history over the last 50,000 years. The data suggest that ...

Six degrees of separation: Why it is a small world after all

October 19, 2017

It's a small world after all - and now science has explained why. A study conducted by the University of Leicester and KU Leuven, Belgium, examined how small worlds emerge spontaneously in all kinds of networks, including ...

Scientists see order in complex patterns of river deltas

October 19, 2017

River deltas, with their intricate networks of waterways, coastal barrier islands, wetlands and estuaries, often appear to have been formed by random processes, but scientists at the University of California, Irvine and other ...

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.