Peer Review Survey 2009: Preliminary findings

September 8, 2009 in Other Sciences / Other

Should peer review detect fraud and misconduct? What does it do for science and what does the scientific community want it to do? Will it illuminate good ideas or shut them down? Should reviewers remain anonymous?

These questions are raised by one of the largest ever international surveys of authors and reviewers, the Peer Review Survey 2009, whose preliminary findings are released today.

Peer review is fundamental to integration of new research findings. It allows other researchers to analyse findings and society at large to weigh up research claims. It results in 1.3 million learned articles published every year, and it is growing rapidly with the expansion of the global research community. With that growth come new concerns - about getting the next generation of researchers to review in sufficient numbers, about maintaining the system's integrity and whether it can be truly globalised; and also new ideas - about alternative quality measures, technologies to prevent , rewarding reviewers and training them.

Sense About Science has promoted understanding of peer review to help people to work out whether research claims have been independently scrutinised. But with all the proposed changes and expansion in research publication, what do researchers think about peer review and its future? To find out, Sense About Science developed the Peer Review Survey 2009, in consultation with and and administered with a grant from Elsevier; the survey included some questions from the Peer Review Survey 20073 for comparison, and new questions about future improvements, public awareness and pressures on the system.

Tracey Brown, Managing Director: "The 2007 survey had raised some of the issues. We sought to broaden that, particularly to find out whether the demand for all this free, independent scrutiny from the research community is sustainable, and what the future of quality control is likely to be. It's a matter of public as well as scientific interest."

Preliminary findings include:

1. Playing an active role in the community is top of reasons to review:
90% say they review because they believe they are playing an active role in the community; only 16% say that increasing their chances of having future papers accepted is a reason to review.

2. Researchers want to improve, not replace peer review:

3. High expectations:
4. Reviewers want anonymity:
58% would be less likely to review if their signed report was published. 76% favour the double blind system where just the editor knows who the reviewers are.

5. Understanding of peer review:
Researchers agree that peer review is well understood by the scientific community but just 30% believe the public understands the term.

6. Papers aren't recognising previous work:
81% think peer review should ensure previous research is acknowledged; 54% think it currently does. This reflects current concerns in the research community.4

7. Detecting plagiarism and fraud might be a noble aim but is not practical:
A majority think should detect plagiarism (81%) or fraud (79%) but fewer (38% & 33%) think it is capable of this.

8. Reviewers divided over incentives:
Just over half of reviewers think receiving a payment in kind (e.g. subscription) would make them more likely to review; 41% wanted payment for reviewing, but this drops to just 2.5% if the author had to cover the cost. Acknowledgement in the journal is the most popular option.

More information: The full findings and report are due to be published in November 2009 and will be available at … php/site/project/29/ .

Source: Elsevier

"Peer Review Survey 2009: Preliminary findings" September 8, 2009