Predicting discoveries—enabling research or killing novelty?

March 7, 2017 by Thea Singer
Northeastern's Roberta Sinatra turns to the “science of science”—an interdisciplinary field that uses the deluge of data available today—to understand what drives scientific discoveries. Credit: iStock

Meteorologists strive to predict the weather. Network scientists develop complex algorithms to predict the spread of disease. Might it also be possible to predict the emergence of scientific discoveries? If the answer is "yes," what are the benefits—and pitfalls—of the ability to do so?

Those are questions that Roberta Sinatra and her colleagues grapple with in a recent essay in the journal Science. For the answers, the researchers turn to the "science of science": an interdisciplinary field that uses the deluge of data available today—everything from the number of citations research papers accrue to individuals' career trajectories—to understand the social components driving .

"Everyone who makes decisions regarding science would like to be able to predict discoveries, from researchers and funding agencies to journal editors and faculty hiring committees," says Sinatra, visiting research assistant professor at Northeastern and assistant professor at Central European University in Budapest. "But there are downsides and upsides to that. In a time of limited resources, such predictions would enable us to use tax dollars for research more effectively. However, if we base predictions primarily on past success, we are biasing the system and perhaps killing novelty."

Predictable or random?

How predictable are scientific discoveries in the first place? It depends on the nature of the research and what aspects of a discovery are being considered, note Sinatra and her coauthors, who work at the University of Colorado, Boulder, and the Santa Fe Institute.

Projects involving large numbers of people doing experiments will accumulate evidence over time, providing clues that a discovery is imminent. Finding the Higgs boson and determining the are two examples of such "expected" discoveries. "It's like looking for a single missing piece to complete a puzzle," says Sinatra. Then there are the discoveries that "come out of the blue," she says, citing the discovery of penicillin, which was so unexpected its significance was not recognized for 15 years. "Sir Alexander Fleming stumbled on a puzzle piece that had no context," she says, referring to the biologist who discovered the antibiotic. "The rest of the puzzle had to grow around it."

Earlier research led by Northeastern's Albert-László Barabási, Robert Gray Dodge Professor and University Distinguished Professor of Physics, found that the timing of creative breakthroughs is also not predictable but random, toppling conventional wisdom, which typically holds that major contributions diminish with age. "Scientists can achieve success at any point in their careers as long as they keep producing," says Sinatra, who was first author on that study.

Roberta Sinatra, Sinatra, visiting research assistant professor at Northeastern and assistant professor at Central European University in Budapest. Credit: Santiago Gil

Still, mining today's vast troves of data with sophisticated algorithms and other tools reveals patterns that provide insight into aspects of discovery that can indicate future success. "Researchers whose papers have a lot of citations will continue to produce papers that get lots of citations," says Sinatra. "The combination of visibility, luck, and positive response form a feedback loop. It's the same mechanism driving the rich-get-richer dynamic."

So which explains more about the drivers generating scientific discovery—randomness, as shown with penicillin and the timing of breakthroughs, or predictability, as shown with the citations?

"We have to keep the element of risk, because that is how research progresses," says Sinatra. "On the other hand, we know that the patterns can help guide our understanding of the process of discovery. We must continue exploring both contributions."

A wake-up call

The patterns revealed through data mining also sound a wake-up call, says Sinatra. They show a systematic bias toward women and some minorities, meaning that those researchers' papers are cited less frequently. And a select group of prestigious institutions dominate where discoverers are trained, leading to a constriction of the areas researched as well as the makeup of the entire scientific workforce.

"These biases lead to resources such as grants and faculty appointments being concentrated on particular groups, including white males living in North America," says Sinatra. "This is a big issue. We and other researchers studying the science of science are continuing to collect data and quantify the magnitude of this bias."

She and her coauthors conclude that perhaps the best way to ensure the continued generation of new discoveries may be to focus not on predicting individual breakthroughs but on encouraging "a healthy ecosystem of scientists."

"As physicist Freeman Dyson notes in his essay Birds and Frogs, a discovery is not made by just one individual or via one project but by a community, an ecosystem," says Sinatra. "So what we have to nurture is not just individuals but the entire ecosystem. That means emphasizing the work of the visionaries—the 'birds' of the ecosystem, who see the big picture—as well as that of the 'frogs,' who see the details and do the technical work fundamental to the whole. Indeed, if we destroy that balance, we might destroy the entire process of discovery."

Explore further: Success can come at any age, according to study

More information: Aaron Clauset et al. Data-driven predictions in the science of science, Science (2017). DOI: 10.1126/science.aal4217

Related Stories

Success can come at any age, according to study

November 4, 2016

What does age have to do with creative breakthroughs in science? Not much, according to new research led by Northeastern network scientist Albert-László Barabási. Rather, it is productivity and the will to keep trying ...

Researchers use science to predict success

October 7, 2013

We all want to know the secret to success and physicists are no different. Like the rest of the academic community, physicists rely on various quantitative factors to determine whether a researcher will enjoy long-term success. ...

Recommended for you

UN says world population will reach 9.8 billion in 2050

June 22, 2017

India's population is expected to surpass China's in about seven years and Nigeria is projected to overtake the United States and become the third most populous country in the world shortly before 2050, a U.N. report said ...

The story of music is the story of humans

June 20, 2017

How did music begin? Did our early ancestors first start by beating things together to create rhythm, or use their voices to sing? What types of instruments did they use? Has music always been important in human society, ...

1 comment

Adjust slider to filter visible comments by rank

Display comments: newest first

RobertKarlStonjek
not rated yet Mar 07, 2017
The job of science is to discover what we don't know...and one of the things that we don't know is what can or will be discovered.

By confining yourself to what is already known, you condemn novelty, and therefore truly new and unexpected discoveries, to the past.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.