NASA brings Earth science 'big data' to the cloud with Amazon web services

Nov 13, 2013
Climate change projections for the United States, such as the data shown in this image of average springtime temperature change from the 1950s to the 2090s, will be available on the cloud through an agreement with Amazon Web Services. This data was produced by the NASA Earth Exchange (NEX), a research platform of the NASA Advanced Supercomputer Facility at the agency's Ames Research Center in Moffett Field, Calif. Credit: NASA

(Phys.org) —NASA and Amazon Web Services Inc. (AWS) of Seattle, Wash., are making a large collection of NASA climate and Earth science satellite data available to research and educational users through the AWS cloud.

The system enhances research and educational opportunities for the U.S. geoscience community by promoting community-driven research, innovation and collaboration.

"NASA continues to support and provide open public access to research data, and this collaboration is entirely consistent with that objective," said NASA Chief Scientist Ellen Stofan at the agency's headquarters in Washington. "Earth science research is important to every person on the planet, and we welcome contributions from all researchers in improving our understanding of Earth and its climate."

This agreement allows NASA and AWS to experiment with a new way to provide data services. By using the cloud, research and application users worldwide gain access to an integrated Earth science computational and data management system they can use on their own.

The service encompasses selected NASA satellite and global change data sets—including temperature, precipitation, and forest cover—and data processing tools from the NASA Earth Exchange (NEX), a research platform of the NASA Advanced Supercomputer Facility at the agency's Ames Research Center in Moffett Field, Calif.

"We are excited to grow an ecosystem of researchers and developers who can help us solve important environmental research problems," said Rama Nemani, principal scientist for the NEX project at Ames. "Our goal is that people can easily gain access to and use a multitude of data analysis services quickly through AWS to add knowledge and open source tools for others' benefit."

NEX is a collaboration and analytical platform that combines state-of-the-art supercomputing, Earth system modeling, workflow management and NASA remote-sensing data. Through NEX, users can explore and analyze large Earth science data sets, run and share modeling algorithms, collaborate on new or existing projects and exchange workflows and results within and among other science communities.

NASA has uploaded terabytes of data from three satellite and computer modeling datasets to the AWS platform and will upload more in the future. One data set, the NEX downscaled climate simulations, provides high-resolution climate change projections for the 48 contiguous U.S. states. The second data set, provided by the Moderate Resolution Imaging Spectroradiometer (MODIS) instrument on NASA's Terra and Aqua satellites, offers a global view of Earth's surface every 1 to 2 days. Finally, the Landsat data record from the U.S. Geological Survey provides the longest existing continuous space-based record of Earth's land.

NASA climate data sets provided to AWS will continue to be available to the public in a full and open manner. The effort continues NASA's adoption of cloud platforms to enhance digital services, enabling NASA to make more U.S. government data easy to find and access without having to download large amounts of data. In line with the Obama Administration's Open Data Executive Order, this new collaboration encourages citizen entrepreneurs to create businesses, innovate, and conduct scientific research.

The NASA datasets will be available through the Amazon Public Data Sets program at: aws.amazon.com/datasets

This website provides a centralized repository of selected public data sets that can be integrated into AWS cloud-based applications to reduce the time and cost associated with transferring large data sets.

"By bringing these NASA public data assets into the AWS cloud, we help NASA engage a larger community for global change impact modeling and analysis as well as data sciences innovation in general," said Jamie Kinney, AWS senior manager for scientific computing. "Together, NASA and AWS are delivering faster time to science and taking the complexity out of accessing this important climate data."

Explore further: NASA launches study of new global land imaging system

More information: NASA NEX: aws.amazon.com/nasa/nex/

add to favorites email to friend print save as pdf

Related Stories

NASA Announces A New Approach To Earth Science Data Analysis

Apr 20, 2010

(PhysOrg.com) -- The way we analyze planet Earth will never be the same, thanks to a new initiative at NASA that integrates supercomputers with global satellite observations and sophisticated models of the Earth system in ...

NASA's 'Earth Now' app now available for Android

Sep 11, 2012

(Phys.org)—One of the top iPhone education apps in the iTunes store is now available for Android. The free NASA "Earth Now" Android app immerses cyber explorers in dazzling visualizations of near-real-time ...

NASA launches study of new global land imaging system

Sep 20, 2013

NASA and the U.S. Geological Survey (USGS) will kick off a quest for an innovative and affordable space-based system to extend the Landsat satellite data record for decades to come with a public forum and call for ideas Wednesday, ...

New public application of Landsat images released

May 13, 2013

(Phys.org) —Google released more than a quarter-century of images of Earth taken from space Thursday compiled into an interactive time-lapse experience. Working with data from the Landsat Program managed ...

NASA's new 'Earth now' app: your world, unplugged

Mar 20, 2012

A free, new iPhone app from NASA literally puts the whole world in the palm of your hands. "Earth Now" immerses cyber explorers in dazzling visualizations of near-real-time global climate data from NASA's ...

Amazon shifted strategy in pursuit of CIA contract

Aug 27, 2013

It was a contract that Amazon.com's business-technology group wasn't supposed to get. The CIA, an organization whose data is among the most protected in the world, asked for bids last year on a contract to provide the agency ...

Recommended for you

Image: Rosetta's comet looms

1 hour ago

Wow! Rosetta is getting ever-closer to its target comet by the day. This navigation camera shot from Aug. 23 shows that the spacecraft is so close to Comet 67P/Churyumov-Gerasimenko that it's difficult to ...

A salty, martian meteorite offers clues to habitability

2 hours ago

Life as we know it requires energy of some sort to survive and thrive. For plants, that source of energy is the Sun. But there are some microbes that can survive using energy from chemical reactions. Some ...

User comments : 0