The limits of phenomenology

August 22, 2013, New England Complex Systems Institute

What's wrong with the science of science? Do the methods we use to explore new innovations in psychology, drug testing and engineering design really work? A new paper has troubling answers: Big Data isn't big enough to be useful. We face a problem with the empirical. We had best re-examine our confidence that conventional methods of scientific research can deliver real answers.

The paper, "The Limits of Phenomenology: From Behaviorism to Drug Testing and Engineering Design" by Yaneer Bar-Yam, president of the New England Complex Systems Institute, spells out why the only answer is a turn toward to work out the world's most critical challenges—managing social and political conflicts, testing drugs, and achieving better designed infrastructure included.

"Data by itself is not enough," said Bar-Yam, in discussing conventional systems of collecting information. "There are so many factors that play a role that no empirical observation is ever useful to tell us what will happen in the future. The same conditions never happen twice."

Bar-Yam's examples of where conventional go astray include , where safety data from trials appears to offer adequate support for positive conclusions and yet the drugs carry severe, even lethal, side effects. Drug testing even in using the accepted gold standard of double blind randomized control tests cannot determine and side effects. No number of trials can determine them. In engineering, large projects such as US modernization and British medical records systems, costing up to $6 billion and $10 billion, respectively, were held up because they could not pass tests.

Bar-Yam makes a case for complex models that can deliver greater understanding because complex models take into account more factors than meet the eye.

"Our results imply that we need to improve our ability to model complex interacting systems," he said. Big data—with all its power to amass information about everything and anything captured by the second, does not provide answers that are useful. In recent years, he noted, complexity scientists have unraveled the financial crisis, determined the causes of riots and revolutions and mapped the social networks we are part of. They managed to do this because complex systems science involves validated modeling.

Said Bar-Yam: "In order to represent the behavior of a system in response to a large set of possible conditions, it is necessary to have a representation of the system that identi?es the response to cases that have not been observed. A model enables inference to determine the behavior of a system across a range of conditions."

No empirical observation, he added, is ever useful as a direct measure of a future observation. "It is only through generalization motivated by some form of model/theory that we can use past information to address future circumstances."

Explore further: Was the Arab Spring a false one?

More information: Bar-Yam, Y. The Limits of Phenomenology: From Behaviorism to Drug Testing and Engineering Design, arXiv 1308.3094, August 1, 2013.

Related Stories

Was the Arab Spring a false one?

December 14, 2012

he Arab Spring has turned to winter. A year after protests, demonstrations and uprisings rocked the Arab world, hopes for peaceful transitions and free elections are fading in Egypt, Libya, and especially Syria, while elsewhere ...

Scientists show how to make peace

October 19, 2011

Can science predict peace? Can scientific modeling help to end crises in today’s war-torn regions? New research from the New England Complex Systems Institute (NECSI) says yes.

Scientists flag global food pricing too hot to ignore

September 27, 2011

A paper on the surge in world food prices is calling on private and public policy makers to recognize the serious impact that price spikes in food bring to the world’s most vulnerable populations.

Study twitter-maps new world order

February 19, 2012

( -- A new study of tweets spreading news from The New York Times finds that the Internet, while creating an open line of communication across continents, may at the same time be strengthening walls that separate ...

Analysis Shows Uptick Rule Vital to Market Stability

November 18, 2008

( -- A new study by researchers at the New England Complex Systems Institute found that interpretations of data from an SEC pilot program used to justify the repeal of the "uptick rule" in the summer of 2007 are ...

Recommended for you

Archaeologists discover Incan tomb in Peru

February 16, 2019

Peruvian archaeologists discovered an Incan tomb in the north of the country where an elite member of the pre-Columbian empire was buried, one of the investigators announced Friday.

Where is the universe hiding its missing mass?

February 15, 2019

Astronomers have spent decades looking for something that sounds like it would be hard to miss: about a third of the "normal" matter in the Universe. New results from NASA's Chandra X-ray Observatory may have helped them ...

What rising seas mean for local economies

February 15, 2019

Impacts from climate change are not always easy to see. But for many local businesses in coastal communities across the United States, the evidence is right outside their doors—or in their parking lots.

The friendly extortioner takes it all

February 15, 2019

Cooperating with other people makes many things easier. However, competition is also a characteristic aspect of our society. In their struggle for contracts and positions, people have to be more successful than their competitors ...

1 comment

Adjust slider to filter visible comments by rank

Display comments: newest first

not rated yet Aug 23, 2013
Yikes, " the science of science". Sweet!

But this is about generic complex systems and the problem of constraining them, not about real systems (often linear as shown by PCA).

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.