The limits of phenomenology

Aug 22, 2013

What's wrong with the science of science? Do the methods we use to explore new innovations in psychology, drug testing and engineering design really work? A new paper has troubling answers: Big Data isn't big enough to be useful. We face a problem with the empirical. We had best re-examine our confidence that conventional methods of scientific research can deliver real answers.

The paper, "The Limits of Phenomenology: From Behaviorism to Drug Testing and Engineering Design" by Yaneer Bar-Yam, president of the New England Complex Systems Institute, spells out why the only answer is a turn toward to work out the world's most critical challenges—managing social and political conflicts, testing drugs, and achieving better designed infrastructure included.

"Data by itself is not enough," said Bar-Yam, in discussing conventional systems of collecting information. "There are so many factors that play a role that no empirical observation is ever useful to tell us what will happen in the future. The same conditions never happen twice."

Bar-Yam's examples of where conventional go astray include , where safety data from trials appears to offer adequate support for positive conclusions and yet the drugs carry severe, even lethal, side effects. Drug testing even in using the accepted gold standard of double blind randomized control tests cannot determine and side effects. No number of trials can determine them. In engineering, large projects such as US modernization and British medical records systems, costing up to $6 billion and $10 billion, respectively, were held up because they could not pass tests.

Bar-Yam makes a case for complex models that can deliver greater understanding because complex models take into account more factors than meet the eye.

"Our results imply that we need to improve our ability to model complex interacting systems," he said. Big data—with all its power to amass information about everything and anything captured by the second, does not provide answers that are useful. In recent years, he noted, complexity scientists have unraveled the financial crisis, determined the causes of riots and revolutions and mapped the social networks we are part of. They managed to do this because complex systems science involves validated modeling.

Said Bar-Yam: "In order to represent the behavior of a system in response to a large set of possible conditions, it is necessary to have a representation of the system that identi?es the response to cases that have not been observed. A model enables inference to determine the behavior of a system across a range of conditions."

No empirical observation, he added, is ever useful as a direct measure of a future observation. "It is only through generalization motivated by some form of model/theory that we can use past information to address future circumstances."

Explore further: Earthquake simulation tops one quadrillion flops

More information: Bar-Yam, Y. The Limits of Phenomenology: From Behaviorism to Drug Testing and Engineering Design, arXiv 1308.3094, August 1, 2013.

add to favorites email to friend print save as pdf

Related Stories

Was the Arab Spring a false one?

Dec 14, 2012

he Arab Spring has turned to winter. A year after protests, demonstrations and uprisings rocked the Arab world, hopes for peaceful transitions and free elections are fading in Egypt, Libya, and especially Syria, while elsewhere ...

Scientists show how to make peace

Oct 19, 2011

Can science predict peace? Can scientific modeling help to end crises in today’s war-torn regions? New research from the New England Complex Systems Institute (NECSI) says yes.

Scientists flag global food pricing too hot to ignore

Sep 27, 2011

A paper on the surge in world food prices is calling on private and public policy makers to recognize the serious impact that price spikes in food bring to the world’s most vulnerable populations.

Study twitter-maps new world order

Feb 19, 2012

( -- A new study of tweets spreading news from The New York Times finds that the Internet, while creating an open line of communication across continents, may at the same time be strengthening walls that separate ...

Analysis Shows Uptick Rule Vital to Market Stability

Nov 18, 2008

( -- A new study by researchers at the New England Complex Systems Institute found that interpretations of data from an SEC pilot program used to justify the repeal of the "uptick rule" in the summer of 2007 are ...

Recommended for you

Dish Network denies wrongdoing in $2M settlement

8 hours ago

The state attorney general's office says Dish Network Corp. will reimburse Washington state customers about $2 million for what it calls a deceptive surcharge, but the satellite TV provider denies any wrongdoing.

Yahoo sees signs of growth in 'core' (Update)

8 hours ago

Yahoo reported a stronger-than-expected first-quarter profit Tuesday, results hailed by chief executive Marissa Mayer as showing growth in the Web giant's "core" business.

Intel reports lower 1Q net income, higher revenue

9 hours ago

Intel's earnings fell in the first three months of the year amid a continued slump in the worldwide PC market, but revenue grew slightly because of solid demand for tablet processors and its data center services.

Earthquake simulation tops one quadrillion flops

11 hours ago

A team of computer scientists, mathematicians and geophysicists at Technische Universitaet Muenchen (TUM) and Ludwig-Maximillians Universitaet Muenchen (LMU) have – with the support of the Leibniz Supercomputing ...

Twitter buys data analytics partner Gnip

12 hours ago

Twitter says it has bought its data partner Gnip, which provides analysis of the more than 500 million tweets its users share each day—to advertisers, academic institutions, politicians and other customers.

User comments : 1

Adjust slider to filter visible comments by rank

Display comments: newest first

not rated yet Aug 23, 2013
Yikes, " the science of science". Sweet!

But this is about generic complex systems and the problem of constraining them, not about real systems (often linear as shown by PCA).

More news stories

Intel reports lower 1Q net income, higher revenue

Intel's earnings fell in the first three months of the year amid a continued slump in the worldwide PC market, but revenue grew slightly because of solid demand for tablet processors and its data center services.

Low Vitamin D may not be a culprit in menopause symptoms

A new study from the Women's Health Initiative (WHI) shows no significant connection between vitamin D levels and menopause symptoms. The study was published online today in Menopause, the journal of The North American Menopa ...

Astronomers: 'Tilt-a-worlds' could harbor life

A fluctuating tilt in a planet's orbit does not preclude the possibility of life, according to new research by astronomers at the University of Washington, Utah's Weber State University and NASA. In fact, ...