Advanced Analysis Tools Aim to Reduce Uncertainty in Climate Data

Mar 26, 2010
Diagram of data inputs of all natural processes to simulate Earth's complex climate system.

Pacific Northwest National Laboratory researchers have developed a new, advanced data-reduction method -- Stochastic Proper Orthogonal Decomposition -- that will greatly improve the capability to deal with uncertainty in the high-dimensional noisy data from random simulations.

Additionally, researchers have created a general approach for nonlinear bi-orthogonal decomposition of random fields to deal with uncertainty in climate model data as well as in measurements. Researchers have developed an efficient algorithm based on this approach to find the optimal positions for sensor placement to obtain . This will help further reduce uncertainty in the data.

These results are part of a project funded by ASCR to analyze petascale, noisy data from global climate models and available experimental data to predict global warming scenarios.

If successful, the larger research project will have a revolutionary impact on how scientists analyze petascale, noisy, incomplete data in complex systems and ultimately lead to better future prediction and decision-making.

Extracting scientific knowledge from massive petascale data sets has become increasingly difficult and necessary as com puter systems have grown larger and experimental devices more sophisti cated. Petascale computers are capable of performing one quadrillion—one million billion—operations per second.

Numerical models and experimental approaches have their own limitations. Data-driven simulations at the petascale level could lead to great advances in accurately predicting the performance of dynamic data-driven systems. But the main bottleneck to reducing uncertainty is the ability to attract useful information from the petascale out puts of large-scale unsteady simulations. In addition, the uncertainty associ ated with the simulation inputs may render the results of these highly expensive simulations erroneous, especially in long-term predictions. Therefore, advanced data analysis tools, such as Stochastic Proper Orthogonal Decomposition, have to be developed to deal with petscale level noisy, incomplete data sets.

Noise-induced transition in the gradient systems, where the vector field is the gradient of a potential function, has been studied for a long time and understood very well. However, the understanding of transition events in non-gradient systems, such as climate system, is much less satisfactory. To effectively detect and predict the transition pathways in non-gradient systems, researchers have employed the minimum action method (MAM) derived from the large deviation theory. Researchers have successfully used the MAM method to detect the minimum action paths for the two dimensional noise-driven Ginzburgh-Laudau system and the Kuramoto-Sivashinsky equation.

Researchers will be applying the developed framework to climate science, where effective petascale data-reduction techniques are critical to analyzing the huge amount of numerical and experimental data generated from petaflop computers and high-throughput instruments.

Explore further: Researchers help Boston Marathon organizers plan for 2014 race

More information: Wan, X, X Zhou and W E. 2010. "Study of the noise-induced transition and the exploration of the phase space for the Kuramoto-Sivashinsky equation using the minimum action methodaction method," Nonlinearity 23, 475-493.

add to favorites email to friend print save as pdf

Related Stories

Petascale climate modeling heats up

Sep 04, 2008

The development of powerful supercomputers capable of analyzing decades of data in the blink of an eye mark a technological milestone capable of bringing comprehensive changes to science, medicine, engineering, and business ...

New technology enables high-speed data transfer

Jun 18, 2009

GridFTP, a protocol developed by researchers at Argonne National Laboratory, has been used to transfer unprecedented amounts of data over the Department of Energy's (DOE) Energy Sciences Network (ESnet), which provides a ...

Recommended for you

Newlyweds, be careful what you wish for

2 hours ago

A statistical analysis of the gift "fulfillments" at several hundred online wedding gift registries suggests that wedding guests are caught between a rock and a hard place when it comes to buying an appropriate gift for the ...

Can new understanding avert tragedy?

5 hours ago

As a boy growing up in Syracuse, NY, Sol Hsiang ran an experiment for a school project testing whether plants grow better sprinkled with water vs orange juice. Today, 20 years later, he applies complex statistical ...

Crowd-sourcing Britain's Bronze Age

6 hours ago

A new joint project by the British Museum and the UCL Institute of Archaeology is seeking online contributions from members of the public to enhance a major British Bronze Age archive and artefact collection.

Roman dig 'transforms understanding' of ancient port

6 hours ago

(Phys.org) —Researchers from the universities of Cambridge and Southampton have discovered a new section of the boundary wall of the ancient Roman port of Ostia, proving the city was much larger than previously ...

User comments : 2

Adjust slider to filter visible comments by rank

Display comments: newest first

vanderMerwe
not rated yet Mar 27, 2010
Here's a thought. Why don't we just go out and sort out all the BS in the world network of weather stations instead so that we don't have to wave magic wands like this over crap data in the future?

We could also start taking hourly data from weather stations again after abandoning the practice a few decades ago because of a crackbrained new policy aimed at saving mag tape. I ran into that bit of idiocy in South Africa when I was developing typical climate data weather years for the CSIR down there in the mid-1980's.
El_Nose
3 / 5 (1) Mar 29, 2010
I am inclined to believe three things

1) due to massive cutbacks we have reduced the number of field stations in unpopulated areas by over 50% - this may lead to a data scew

2) 60 years ago the fear was that the earth was getting colder

3) It doesn't actually matter if the climate people are right or wrong --- But the preventative measures we are starting to take are a good thing no matter what. Cleaner energy production is a good thing -- becoming more effiecent is a good thing -- recycling more is a good thing...

so F the models -- no one cares anymore -- but lets not stop funding a good thing -- if only education could get such money in the US

4) - i know and extra one - we as humans haven;t been collecting data long enough (100 yrs) to know a trend in a planet thats had trends over 10,000,000 years.

Lets face it science has confirmed one thing -- every few million years water engulfs the planet and then recedes and life on land , if it survived - starts up again

More news stories

Newlyweds, be careful what you wish for

A statistical analysis of the gift "fulfillments" at several hundred online wedding gift registries suggests that wedding guests are caught between a rock and a hard place when it comes to buying an appropriate gift for the ...

Can new understanding avert tragedy?

As a boy growing up in Syracuse, NY, Sol Hsiang ran an experiment for a school project testing whether plants grow better sprinkled with water vs orange juice. Today, 20 years later, he applies complex statistical ...

Crowd-sourcing Britain's Bronze Age

A new joint project by the British Museum and the UCL Institute of Archaeology is seeking online contributions from members of the public to enhance a major British Bronze Age archive and artefact collection.

Roman dig 'transforms understanding' of ancient port

(Phys.org) —Researchers from the universities of Cambridge and Southampton have discovered a new section of the boundary wall of the ancient Roman port of Ostia, proving the city was much larger than previously ...

Tiny power plants hold promise for nuclear energy

Small underground nuclear power plants that could be cheaper to build than their behemoth counterparts may herald the future for an energy industry under intense scrutiny since the Fukushima disaster, the ...

Hand out money with my mobile? I think I'm ready

A service is soon to launch in the UK that will enable us to transfer money to other people using just their name and mobile number. Paym is being hailed as a revolution in banking because you can pay peopl ...