Transparency in peer review

September 8, 2017 by Phil Hurst, The Royal Society
The Duke of Sussex. Credit: The Royal Society

In 1832, the Royal Society moved from using committee minutes to written peer review reports for determining what was published in Philosophical Transactions. This was conveyed by Frederick Augustus, The Duke of Sussex in his Presidential address of November that year.

The reports were written by members of Council and were often made public. They were 'often more valuable than the original communications upon which they are founded'.

The reporting was collaborative and referees were expected to reach a consensus. This was time consuming and could be problematic, especially when referees disagreed. It was therefore abandoned after 1832, and both reports and the names of reviewers were kept confidential.

It wasn't until the dawn of the 21st Century that publishers (such as BMC, BMJ and PLoS) started to seriously experiment with open .

Transparency is back in vogue

Why is this? The first reason is the politicisation of science. A good example is climate change—when scientists from the University of East Anglia were bombarded with freedom of information requests by climate sceptics, it became clear there was a lack of and this was used to undermine the veracity of the research. Policy based on published research is under increased scrutiny.

The second reason stems from the open science and open access agenda. Much research is funded by the public purse and it is argued that the published output from this research should be available to all. It follows that the evidence—data, peer —on which claims are made should be made open too.

Finally, transparency has the potential to improve the quality of research and reduce research misconduct. Traditional peer review is confidential, with research papers scrutinised by a small number of anonymous experts. Although publishers are vigilant, this secrecy provides the opportunity for fraud.

Transparency in peer review
Credit: The Royal Society

In 2014, the Royal Society launched the journal Royal Society Open Science which offers optional open peer review where reports are published along with articles. This has proved popular with the majority of authors opting for publication of peer review reports and half of reviewers signing their reports. The uptake varies by scientific discipline.

Since then, open peer review has been introduced on two further Royal Society journals, Proceedings A and Open Biology.

Benefits of transparency in peer review

There are several benefits to open peer review.

  1. Readers can see the comments by reviewers and reach their own conclusions about the rigour and fairness of the process. They can also see how the authors have responded to the criticism and if any errors or shortcomings in the article have been missed. Readers have more information on which to base any comments they may wish to make after publication. In this way, the published science can be improved.
  2. Reviewers' suggestions to improve the paper are available to everyone as examples of what makes a good review. This is particularly useful for early career scientists who may have limited experience of reviewing articles themselves.
  3. Reviewers tend to write better and more balanced reviews if they know they will be made public.
  4. By signing their reports reviewers can get recognition for this vital contribution to the research process. Peer review recognition services are becoming more common, with examples including Publons and ORCID.

Overall, the whole peer review process gains more trust and accountability when everything is transparent.

Is open peer review just a passing fad (like in 1832)?

Back in 1832, science wasn't ready for transparency – producing detailed written reports for public judgement on the value of a paper was just too much work for the small number of referees, and publicly criticising peers was socially very difficult.

Today, because science is funded largely by the public purse and informs so much public policy, transparency is essential. In recent decades many believe that impact and citations have played far too prominent a role in determining what is published. Transparency is important in helping journals focus on the quality and rigour of the research process rather than its likely impact, originality and even fashion. A vital part of this opening up of peer review is recognising the value of such work as an essential 'output' in assessments for grants and tenure. There is cause for optimism that the abandonment of open peer review in 1832 will not be repeated.

Explore further: Bringing a 'trust but verify' model to journal peer review

Related Stories

Bringing a 'trust but verify' model to journal peer review

July 21, 2017

Academic journals are increasingly asking authors to use transparent reporting practices to "trust, but verify" that outcomes are not being reported in a biased way and to enable other researchers to reproduce the results. ...

Open peer review could result in better quality of peer review

September 29, 2015

Whether or not a research article has been peer reviewed openly can seemingly make a difference to the quality of the peer review, according to research carried out by BioMed Central's Research Integrity Group and Frank Dudbridge ...

Intelligent crowd reviewing of scientific papers tested

June 9, 2017

(—Online chemistry journal Synlett, which is published by Thieme, has tested the idea of intelligent crowd reviewing of scientific papers. The project was the brainchild of Benjamin List, a journal editor (and ...

Online game aims to improve scientific peer review accuracy

November 9, 2011

Peer review of scientific research is an essential component of research publication, the awarding of grants, and academic promotion. Reviewers are often anonymous. However, a new study by researchers at the Johns Hopkins ...

Recommended for you

In colliding galaxies, a pipsqueak shines bright

February 20, 2019

In the nearby Whirlpool galaxy and its companion galaxy, M51b, two supermassive black holes heat up and devour surrounding material. These two monsters should be the most luminous X-ray sources in sight, but a new study using ...

Physicists 'flash-freeze' crystal of 150 ions

February 20, 2019

Physicists at the National Institute of Standards and Technology (NIST) have "flash-frozen" a flat crystal of 150 beryllium ions (electrically charged atoms), opening new possibilities for simulating magnetism at the quantum ...

When does one of the central ideas in economics work?

February 20, 2019

The concept of equilibrium is one of the most central ideas in economics. It is one of the core assumptions in the vast majority of economic models, including models used by policymakers on issues ranging from monetary policy ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.