The limits of phenomenology

Aug 22, 2013

What's wrong with the science of science? Do the methods we use to explore new innovations in psychology, drug testing and engineering design really work? A new paper has troubling answers: Big Data isn't big enough to be useful. We face a problem with the empirical. We had best re-examine our confidence that conventional methods of scientific research can deliver real answers.

The paper, "The Limits of Phenomenology: From Behaviorism to Drug Testing and Engineering Design" by Yaneer Bar-Yam, president of the New England Complex Systems Institute, spells out why the only answer is a turn toward to work out the world's most critical challenges—managing social and political conflicts, testing drugs, and achieving better designed infrastructure included.

"Data by itself is not enough," said Bar-Yam, in discussing conventional systems of collecting information. "There are so many factors that play a role that no empirical observation is ever useful to tell us what will happen in the future. The same conditions never happen twice."

Bar-Yam's examples of where conventional go astray include , where safety data from trials appears to offer adequate support for positive conclusions and yet the drugs carry severe, even lethal, side effects. Drug testing even in using the accepted gold standard of double blind randomized control tests cannot determine and side effects. No number of trials can determine them. In engineering, large projects such as US modernization and British medical records systems, costing up to $6 billion and $10 billion, respectively, were held up because they could not pass tests.

Bar-Yam makes a case for complex models that can deliver greater understanding because complex models take into account more factors than meet the eye.

"Our results imply that we need to improve our ability to model complex interacting systems," he said. Big data—with all its power to amass information about everything and anything captured by the second, does not provide answers that are useful. In recent years, he noted, complexity scientists have unraveled the financial crisis, determined the causes of riots and revolutions and mapped the social networks we are part of. They managed to do this because complex systems science involves validated modeling.

Said Bar-Yam: "In order to represent the behavior of a system in response to a large set of possible conditions, it is necessary to have a representation of the system that identi?es the response to cases that have not been observed. A model enables inference to determine the behavior of a system across a range of conditions."

No empirical observation, he added, is ever useful as a direct measure of a future observation. "It is only through generalization motivated by some form of model/theory that we can use past information to address future circumstances."

Explore further: Coping with floods—of water and data

More information: Bar-Yam, Y. The Limits of Phenomenology: From Behaviorism to Drug Testing and Engineering Design, arXiv 1308.3094, August 1, 2013. necsi.edu/projects/yaneer/phenomenology/phenom.pdf

add to favorites email to friend print save as pdf

Related Stories

Was the Arab Spring a false one?

Dec 14, 2012

he Arab Spring has turned to winter. A year after protests, demonstrations and uprisings rocked the Arab world, hopes for peaceful transitions and free elections are fading in Egypt, Libya, and especially Syria, while elsewhere ...

Scientists show how to make peace

Oct 19, 2011

Can science predict peace? Can scientific modeling help to end crises in today’s war-torn regions? New research from the New England Complex Systems Institute (NECSI) says yes.

Scientists flag global food pricing too hot to ignore

Sep 27, 2011

A paper on the surge in world food prices is calling on private and public policy makers to recognize the serious impact that price spikes in food bring to the world’s most vulnerable populations.

Study twitter-maps new world order

Feb 19, 2012

(PhysOrg.com) -- A new study of tweets spreading news from The New York Times finds that the Internet, while creating an open line of communication across continents, may at the same time be strengthening walls that separate ...

Analysis Shows Uptick Rule Vital to Market Stability

Nov 18, 2008

(PhysOrg.com) -- A new study by researchers at the New England Complex Systems Institute found that interpretations of data from an SEC pilot program used to justify the repeal of the "uptick rule" in the summer of 2007 are ...

Recommended for you

Coping with floods—of water and data

23 hours ago

Halloween 2013 brought real terror to an Austin, Texas, neighborhood, when a flash flood killed four residents and damaged roughly 1,200 homes. Following torrential rains, Onion Creek swept over its banks and inundated the ...

Cloud computing helps make sense of cloud forests

Dec 17, 2014

The forests that surround Campos do Jordao are among the foggiest places on Earth. With a canopy shrouded in mist much of time, these are the renowned cloud forests of the Brazilian state of São Paulo. It is here that researchers ...

User comments : 1

Adjust slider to filter visible comments by rank

Display comments: newest first

Torbjorn_Larsson_OM
not rated yet Aug 23, 2013
Yikes, " the science of science". Sweet!

But this is about generic complex systems and the problem of constraining them, not about real systems (often linear as shown by PCA).

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.