NASA brings Earth science 'big data' to the cloud with Amazon web services

Nov 13, 2013
Climate change projections for the United States, such as the data shown in this image of average springtime temperature change from the 1950s to the 2090s, will be available on the cloud through an agreement with Amazon Web Services. This data was produced by the NASA Earth Exchange (NEX), a research platform of the NASA Advanced Supercomputer Facility at the agency's Ames Research Center in Moffett Field, Calif. Credit: NASA

(Phys.org) —NASA and Amazon Web Services Inc. (AWS) of Seattle, Wash., are making a large collection of NASA climate and Earth science satellite data available to research and educational users through the AWS cloud.

The system enhances research and educational opportunities for the U.S. geoscience community by promoting community-driven research, innovation and collaboration.

"NASA continues to support and provide open public access to research data, and this collaboration is entirely consistent with that objective," said NASA Chief Scientist Ellen Stofan at the agency's headquarters in Washington. "Earth science research is important to every person on the planet, and we welcome contributions from all researchers in improving our understanding of Earth and its climate."

This agreement allows NASA and AWS to experiment with a new way to provide data services. By using the cloud, research and application users worldwide gain access to an integrated Earth science computational and data management system they can use on their own.

The service encompasses selected NASA satellite and global change data sets—including temperature, precipitation, and forest cover—and data processing tools from the NASA Earth Exchange (NEX), a research platform of the NASA Advanced Supercomputer Facility at the agency's Ames Research Center in Moffett Field, Calif.

"We are excited to grow an ecosystem of researchers and developers who can help us solve important environmental research problems," said Rama Nemani, principal scientist for the NEX project at Ames. "Our goal is that people can easily gain access to and use a multitude of data analysis services quickly through AWS to add knowledge and open source tools for others' benefit."

NEX is a collaboration and analytical platform that combines state-of-the-art supercomputing, Earth system modeling, workflow management and NASA remote-sensing data. Through NEX, users can explore and analyze large Earth science data sets, run and share modeling algorithms, collaborate on new or existing projects and exchange workflows and results within and among other science communities.

NASA has uploaded terabytes of data from three satellite and computer modeling datasets to the AWS platform and will upload more in the future. One data set, the NEX downscaled climate simulations, provides high-resolution climate change projections for the 48 contiguous U.S. states. The second data set, provided by the Moderate Resolution Imaging Spectroradiometer (MODIS) instrument on NASA's Terra and Aqua satellites, offers a global view of Earth's surface every 1 to 2 days. Finally, the Landsat data record from the U.S. Geological Survey provides the longest existing continuous space-based record of Earth's land.

NASA climate data sets provided to AWS will continue to be available to the public in a full and open manner. The effort continues NASA's adoption of cloud platforms to enhance digital services, enabling NASA to make more U.S. government data easy to find and access without having to download large amounts of data. In line with the Obama Administration's Open Data Executive Order, this new collaboration encourages citizen entrepreneurs to create businesses, innovate, and conduct scientific research.

The NASA datasets will be available through the Amazon Public Data Sets program at: aws.amazon.com/datasets

This website provides a centralized repository of selected public data sets that can be integrated into AWS cloud-based applications to reduce the time and cost associated with transferring large data sets.

"By bringing these NASA public data assets into the AWS cloud, we help NASA engage a larger community for global change impact modeling and analysis as well as data sciences innovation in general," said Jamie Kinney, AWS senior manager for scientific computing. "Together, NASA and AWS are delivering faster time to science and taking the complexity out of accessing this important climate data."

Explore further: NASA launches study of new global land imaging system

More information: NASA NEX: aws.amazon.com/nasa/nex/

add to favorites email to friend print save as pdf

Related Stories

NASA Announces A New Approach To Earth Science Data Analysis

Apr 20, 2010

(PhysOrg.com) -- The way we analyze planet Earth will never be the same, thanks to a new initiative at NASA that integrates supercomputers with global satellite observations and sophisticated models of the Earth system in ...

NASA's 'Earth Now' app now available for Android

Sep 11, 2012

(Phys.org)—One of the top iPhone education apps in the iTunes store is now available for Android. The free NASA "Earth Now" Android app immerses cyber explorers in dazzling visualizations of near-real-time ...

NASA launches study of new global land imaging system

Sep 20, 2013

NASA and the U.S. Geological Survey (USGS) will kick off a quest for an innovative and affordable space-based system to extend the Landsat satellite data record for decades to come with a public forum and call for ideas Wednesday, ...

New public application of Landsat images released

May 13, 2013

(Phys.org) —Google released more than a quarter-century of images of Earth taken from space Thursday compiled into an interactive time-lapse experience. Working with data from the Landsat Program managed ...

NASA's new 'Earth now' app: your world, unplugged

Mar 20, 2012

A free, new iPhone app from NASA literally puts the whole world in the palm of your hands. "Earth Now" immerses cyber explorers in dazzling visualizations of near-real-time global climate data from NASA's ...

Amazon shifted strategy in pursuit of CIA contract

Aug 27, 2013

It was a contract that Amazon.com's business-technology group wasn't supposed to get. The CIA, an organization whose data is among the most protected in the world, asked for bids last year on a contract to provide the agency ...

Recommended for you

NASA's space station Robonaut finally getting legs

7 hours ago

Robonaut, the first out-of-this-world humanoid, is finally getting its space legs. For three years, Robonaut has had to manage from the waist up. This new pair of legs means the experimental robot—now stuck ...

Sun emits a mid-level solar flare

Apr 18, 2014

The sun emitted a mid-level solar flare, peaking at 9:03 a.m. EDT on April 18, 2014, and NASA's Solar Dynamics Observatory captured images of the event. Solar flares are powerful bursts of radiation. Harmful ...

Impact glass stores biodata for millions of years

Apr 18, 2014

(Phys.org) —Bits of plant life encapsulated in molten glass by asteroid and comet impacts millions of years ago give geologists information about climate and life forms on the ancient Earth. Scientists ...

The importance of plumes

Apr 18, 2014

The Hubble Space Telescope is famous for finding black holes. It can pick out thousands of galaxies in a patch of sky the size of a thumbprint. The most powerful space telescope ever built, the Hubble provided ...

User comments : 0

More news stories

NASA's space station Robonaut finally getting legs

Robonaut, the first out-of-this-world humanoid, is finally getting its space legs. For three years, Robonaut has had to manage from the waist up. This new pair of legs means the experimental robot—now stuck ...

Cosmologists weigh cosmic filaments and voids

(Phys.org) —Cosmologists have established that much of the stuff of the universe is made of dark matter, a mysterious, invisible substance that can't be directly detected but which exerts a gravitational ...

Ex-Apple chief plans mobile phone for India

Former Apple chief executive John Sculley, whose marketing skills helped bring the personal computer to desktops worldwide, says he plans to launch a mobile phone in India to exploit its still largely untapped ...

Filipino tests negative for Middle East virus

A Filipino nurse who tested positive for the Middle East virus has been found free of infection in a subsequent examination after he returned home, Philippine health officials said Saturday.

Egypt archaeologists find ancient writer's tomb

Egypt's minister of antiquities says a team of Spanish archaeologists has discovered two tombs in the southern part of the country, one of them belonging to a writer and containing a trove of artifacts including reed pens ...

Airbnb rental site raises $450 mn

Online lodging listings website Airbnb inked a $450 million funding deal with investors led by TPG, a source close to the matter said Friday.