How to Spot an Influential Paper Based on its Citations

Jul 04, 2009 by Lisa Zyga weblog
By factoring out the effects of timing, scientists may be able to find papers whose large numbers of citations are due to reasons such as high quality content. Credit: Wikimedia.

(PhysOrg.com) -- At first it may seem that the number of citations received by a published scientific paper is directly related to that paper's quality of content. The higher the quality, the more people read and cite that paper. However, the number of citations received by a paper depends more on when that paper was published; papers published early in a new field receive many more citations than those published later on. Although this effect has previously been known, a recent study has tested and verified the so-called "first mover advantage" with data from selected fields.

"The common-sense reasoning behind this observation is that papers published early in a field receive citations essentially regardless of content because they are the only game in town," wrote the study's author, physicist Mark Newman of the University of Michigan. "Authors feel the need to cite something and if there is only a small number of relevant publications then inevitably those publications get cited. This gives the earliest publications a head start that is subsequently amplified by the preferential attachment process and they will continue to receive citations indefinitely at a higher rate than later papers because they have more citations to begin with."

As Newman noted, the first person to investigate this issue was the "physicist-turned-historian-of-science" Derek de Solla Price. In 1965, Price presented one of the first studies of networks of citations between papers. He found that, while most papers receive only a small number of citations, a few receive a very large number of citations. Later, this distribution pattern became known as "preferential attachment," and the papers with lots of citations were found to be the early ones.

In his , Newman calculated the exact size of this first-mover effect (the number of citations as a function of time) within the preferential attachment model. When comparing the results with citation data from a number of fields, he found that the size and duration of the effect often agree closely with the theoretical predictions. In addition, by factoring out the effects of timing, Newman could determine which papers were cited not because they came first, but for other reasons, such as quality of content.

"If we measure a paper's citation count relative to the average in its field for the given publication date, then this effect is factored out and - perhaps - the true stars of the citation galaxy will emerge," Newman wrote.

He concludes that, on one hand, a cynical observer who wants to be highly cited would be better off writing the first paper in a new field than writing the best paper in a more mature field. But from another point of view, understanding this effect could also help readers find papers that buck the first-mover trend, as these papers could contain true breakthroughs.

More information: M.E.J. Newman. "The first-mover advantage in scientific publication." 2009 EPL 86 68001 (6pp) doi: 10.1209/0295-5075/86/68001

© 2009 PhysOrg.com

Explore further: Information storage for the next generation of plastic computers

add to favorites email to friend print save as pdf

Related Stories

New method ranks quality of scientific journals by field

Feb 27, 2008

Worldwide, the number of scientists is increasing as is the number of scientific journals and published papers, the latter two thanks in large part to the rise of electronic publishing. Scientists and other researchers are ...

Physicist Proposes New Way to Rank Scientific Output

Nov 08, 2005

Publications in peer-reviewed journals are the yardstick by which academic scientists compare their work with their colleagues. But is the best measure of a scientist’s worth the total number of his or her published papers? ...

Prospecting for Scientific 'Gems' with Google

May 03, 2006

Science is all about quantitative measurement, so it should come as no surprise that scientists have a long tradition of measuring their influence on each other. Traditionally, the most important measure of ...

Can downloads predict impact for scientific articles?

Apr 10, 2009

While the number of times a scientific article is cited by other articles is currently the gold standard for ranking its impact, online publishing offers another measure: the number of unique downloads.

UCSC ranked first in nation for research impact in physics

Feb 06, 2007

In a new analysis of research publications from top U.S. universities, the University of California, Santa Cruz, ranked first for the impact of its faculty in the field of physics and fifth in the field of space sciences. ...

Recommended for you

Better thermal-imaging lens from waste sulfur

3 hours ago

Sulfur left over from refining fossil fuels can be transformed into cheap, lightweight, plastic lenses for infrared devices, including night-vision goggles, a University of Arizona-led international team ...

How to test the twin paradox without using a spaceship

Apr 16, 2014

Forget about anti-ageing creams and hair treatments. If you want to stay young, get a fast spaceship. That is what Einstein's Theory of Relativity predicted a century ago, and it is commonly known as "twin ...

User comments : 5

Adjust slider to filter visible comments by rank

Display comments: newest first

Sonhouse
5 / 5 (1) Jul 04, 2009
In another words: Einstein was a plagiator, so he never got a Nobel price..

Nobel PRICE? What do you think he got, something from Wal Mart? I assume you are fully aware he did receive the Nobel prize.
Bob_Kob
not rated yet Jul 05, 2009
Not for relativity tho
iamcrazy
not rated yet Jul 05, 2009
Einstein was a fruitcake jim
MatthiasF
5 / 5 (1) Jul 05, 2009
Wouldn't the number of citations correlate to how many people read the work? A paper read by three people but cited by 600 wouldn't make much sense, would it?

So, perhaps the study should conclude that papers written for immature fields are read and cited more? Wouldn't this lead people to fracture fields smaller so more people are "first-movers"?
johanfprins
1 / 5 (1) Jul 06, 2009
There is another problem with first papers in a new field. They become quoted so much that people start to believe that they contain holy dogma. As Joseph Goebbels knew, an often repeated lie becomes a truth. Eventually the scientific community ends up defending wrong physics with the zeal of zealots.
For, example, the paper on Cooper pairs and the BCS model are such manuscripts: Just try and give another possible interpretation for superconduction and you soon find yourself excommunicated from physics; even though it is quite simple to prove beyond doubt that Cooper pairs and BCS cannot explain how an electric-field is cancelled within a suoperconductor. As Einstein has noted it takes only one discrepancy to show that a model is wrong. And these two papers are wrong!

More news stories

Better thermal-imaging lens from waste sulfur

Sulfur left over from refining fossil fuels can be transformed into cheap, lightweight, plastic lenses for infrared devices, including night-vision goggles, a University of Arizona-led international team ...

Robotics goes micro-scale

(Phys.org) —The development of light-driven 'micro-robots' that can autonomously investigate and manipulate the nano-scale environment in a microscope comes a step closer, thanks to new research from the ...

Hackathon team's GoogolPlex gives Siri extra powers

(Phys.org) —Four freshmen at the University of Pennsylvania have taken Apple's personal assistant Siri to behave as a graduate-level executive assistant which, when asked, is capable of adjusting the temperature ...

Deadly human pathogen Cryptococcus fully sequenced

Within each strand of DNA lies the blueprint for building an organism, along with the keys to its evolution and survival. These genetic instructions can give valuable insight into why pathogens like Cryptococcus ne ...