Spanish scientific journals must raise professional standards in order to compete

April 27, 2011
Although 72 percent of the journals gave their reviewers instructions, only 6 percent made any reference to the confidentiality of the paper. Credit: SINC

A study by the Spanish Foundation for Science and Technology (FECYT) shows a lack of standardisation in the peer review systems whereby independent experts assess the content of scientific publications published in Spain. This results in a low level of international competitiveness among these publications.

"We studied the entire process, beyond the fact of such a review simply being stated in the publication. Our research showed a low level of standardisation in these processes. This reflects a need to work to professionalise some of the Spanish analysed", María Ángeles Coslado, lead author of the study, published in the journal El profesional de la información, tells SINC.

The study is based on documentation provided by editors participating in the first round of the Quality Evaluation of Spanish Scientific Journals carried out by the FECYT in 2008. The study analysed a total of 119 publications.

"We examined some of the editorial processes used by these kinds of journals, such as use of external evaluation, provision of instructions to reviewers, the existence of protocols for papers, and the anonymity of those involved in the review", says Coslado.

Out of the 119 journals studied, 32 of them failed to meet the external review requirement. Out of the 87 that did meet this requirement, not all used the same protocols to evaluate work, and so they were discounted.

"The protocols should be a tool that the editor provides the reviewers with, and which should help them to evaluate the formal aspects and content of the paper. They should also act as a means of informing the reviewer of the journal's editorial line, what is expected of the evaluation, and the deadlines for the review", says Izaskun Lacunza, co-author of the study.

Similarly, although 72% of the journals gave their reviewers instructions, only 6% made any reference to the confidentiality of the paper, while 84% failed to ask their reviewers whether they had any conflict of interest.

Preventing 'inbreeding'

The results of the study show that in 94% of the cases studied, there was no indication of whether the reviewers would be paid for their work, while financial payment was only offered in two cases among the remaining 6%.

"In a scientific journal, the purpose of peer revision is to evaluate the scientific quality and originality of the work that researchers send to the publications. The reviewers should be experts in the subject in question and not be linked to the journal publishers. This is to ensure the scientific interest of the articles published, as well as to prevent possible inbreeding – in other words members of the publishing entity acting as reviewers", explains Coslado.

The research by Coslado and Lacunza underlines the fact that, although most journals carry out peer reviews, there is a lack of standardisation between their evaluation protocols. In addition, in one-third of the cases studied, the reviewers were not explicitly required to evaluate the originality of the study, and a large majority of the experts were Spanish, and all of them Spanish speakers.

"The fact that a high percentage of the reviewers are Spanish reflects the lack of internationalisation among Spanish scientific journals, which has a direct effect on their visibility, and as a result makes them a less competitive product at international level", the researcher concludes.

Explore further: Study Reports Conflict-of-Interest Policies and Practices of Major Journals

More information: Maria Ángeles Coslado, Izaskun Lacunza, Germán Ros. "Evaluación de la calidad de revistas científicas españolas: análisis de sus procesos de revisión". El profesional de la información 20 (2): 159 – 164, 2011.

Related Stories

Peer Review Survey 2009: Preliminary findings

September 8, 2009

Should peer review detect fraud and misconduct? What does it do for science and what does the scientific community want it to do? Will it illuminate good ideas or shut them down? Should reviewers remain anonymous?

To publish or not to publish? That is the question

May 21, 2010

For more than 50 years medical research has been vetted through the peer-review process overseen by medical journal editors who assign reviewers to determine whether work merits publication. A study published in PLoS One ...

Federal peer review may be overstretched and error prone

January 10, 2011

The federal peer review system, by which research proposals are judged worthy for funding, may be "over stretched" and "susceptible to error," said Elmer Yglesias, a researcher at the Science and Technology Policy Institute ...

Recommended for you

Who you gonna trust? How power affects our faith in others

October 6, 2015

One of the ongoing themes of the current presidential campaign is that Americans are becoming increasingly distrustful of those who walk the corridors of power – Exhibit A being the Republican presidential primary, in which ...

Ancient genome from Africa sequenced for the first time

October 8, 2015

The first ancient human genome from Africa to be sequenced has revealed that a wave of migration back into Africa from Western Eurasia around 3,000 years ago was up to twice as significant as previously thought, and affected ...

The hand and foot of Homo naledi

October 6, 2015

The second set of papers related to the remarkable discovery of Homo naledi, a new species of human relative, have been published in scientific journal, Nature Communications, on Tuesday, 6 October 2015.

From a very old skeleton, new insights on ancient migrations

October 9, 2015

Three years ago, a group of researchers found a cave in Ethiopia with a secret: it held the 4,500-year-old remains of a man, with his head resting on a rock pillow, his hands folded under his face, and stone flake tools surrounding ...

Mexican site yields new details of sacrifice of Spaniards

October 9, 2015

It was one of the worst defeats in one of history's most dramatic conquests: Only a year after Hernan Cortes landed in Mexico, hundreds of people in a Spanish-led convey were captured, sacrificed and apparently eaten.


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.