Managing the data deluge through new software

Oct 23, 2013

Unprecedented torrents of data flood out of research labs on a continual basis, but making sense of it all remains a major scientific bottleneck. How software is evolving to transform this data deluge into knowledge is the topic of a news story in Chemical & Engineering News, the weekly newsmagazine of the American Chemical Society.

Rick Mullin, senior editor at C&EN, points out that statistical models have allowed researchers to reduce the number of experiments they run, but 40 percent are still unnecessarily repeated due to inefficient experimental design or inadequate information technology. To tame the situation, multiple companies have stepped up with new software to help researchers gain control over the massive data that today's high-throughput labs produce.

The article describes the latest advances in this area, which include new ways to search, access, visualize and analyze data. Some software allows scientists to aggregate and analyze information from various sources. Others combine technology with consulting services to convert raw data into a storage format that's vendor-independent. While providers—and thus the scientists, science and the public benefiting from them—have made considerable progress, advanced informatics that can function at the scale of tens of thousands of variables is still in the works.

Explore further: Predicting health risks of everyday chemicals

More information: "Breaking Big" cen.acs.org/articles/91/i42/Breaking-Big.html

add to favorites email to friend print save as pdf

Related Stories

Predicting health risks of everyday chemicals

Oct 16, 2013

Concern over the safety of everyday household products, such as baby bottles and soaps, has spurred a wide-ranging research effort into predicting the health risks of tens of thousands of chemicals. That's the topic of the ...

Welcome to the new era of University, Inc.

Aug 07, 2013

After years of wariness, universities and industry scientists are forging new partnerships that are reinvigorating academic science departments, preparing students for careers and giving corporations better access to fundamental ...

Using millions of gigs of data to improve human health

Feb 20, 2013

With biomedical scientists struggling to collect and analyze millions of gigabytes of data in their efforts to improve human health, the National Institutes of Health has launched a $700 million project to ...

A new sense of urgency for energy cane and other energy crops

Aug 14, 2013

"Energy cane" may sound like a trendy sports drink, but it actually is among a new generation of energy crops that could yield up to 5 times more ethanol per acre than corn. They are the topic of the cover story in this week's ...

Recommended for you

New method to analyse how cancer cells die

4 hours ago

(Phys.org) —A team from The University of Manchester – part of the Manchester Cancer Research Centre - have found a new method to more efficiently manufacture a chemical used to monitor cancer cells.

User comments : 0

More news stories

New method to analyse how cancer cells die

(Phys.org) —A team from The University of Manchester – part of the Manchester Cancer Research Centre - have found a new method to more efficiently manufacture a chemical used to monitor cancer cells.

Mantis shrimp stronger than airplanes

(Phys.org) —Inspired by the fist-like club of a mantis shrimp, a team of researchers led by University of California, Riverside, in collaboration with University of Southern California and Purdue University, ...

New breast cancer imaging method promising

The new PAMmography method for imaging breast cancer developed by the University of Twente's MIRA research institute and the Medisch Spectrum Twente hospital appears to be a promising new method that could ...

Research proves nanobubbles are superstable

The intense research interest in surface nanobubbles arises from their potential applications in microfluidics and the scientific challenge for controlling their fundamental physical properties. One of the ...

Using antineutrinos to monitor nuclear reactors

When monitoring nuclear reactors, the International Atomic Energy Agency has to rely on input given by the operators. In the future, antineutrino detectors may provide an additional option for monitoring. ...