NASA Explores potential of altered realities for space engineering and science

August 10, 2017 by Lori Keesey, NASA's Goddard Space Flight Center
Using headgear and handsets, users can assemble a spacecraft in a new virtual-reality application now being developed with NASA R&D funding. Credit: NASA

Virtual and augmented reality are transforming the multi-billion-dollar gaming industry. A team of NASA technologists now is investigating how this immersive technology could profit agency engineers and scientists, particularly in the design and construction of spacecraft and the interpretation of scientific data.

Thomas Grubb, an engineer at NASA's Goddard Space Flight Center in Greenbelt, Maryland, is leading a team of center technical experts and university students to develop six multidisciplinary pilot projects highlighting the potential of virtual and , also known as VR and AR. These pilots showcase current capabilities in engineering operations and science, but also provide a glimpse into how technologists could use the in the future.

"Anyone who followed the popularity of Pokémon Go has seen how the public has embraced this technology," said Grubb, referring to the augmented-reality game that quickly became a global sensation in 2016. "Just as it's changing the , it will change the way we do our jobs," Grubb added. "Five years from now, it's going to be amazing."

To understand the potential, Grubb, whose project is funded by NASA's Center Innovation Fund, said people need to understand the technology's differences and how it has evolved.

Virtual reality typically involves wearing a headset that allows the user to experience and interact with an artificial, computer-generated reality. By combining computer-generated 3-D graphics and coded behaviors—that is, how the app will respond when the user chooses an action—these simulations can be used for design and analysis, entertainment, and training. They allow the user to feel like he or she is experiencing the situation firsthand.

Augmented reality, on the other hand, doesn't move the user to a different place, but adds something to it. As with Pokémon Go, augmented reality is made possible through low-end devices like smartphones and high-end AR headsets that blend digital components into the real world. In other words, with virtual reality, the user swims with the sharks; with augmented reality, the shark pops out of the user's cellphone.

Goddard technologist Tom Grubb believes that low-cost, high-capability augmented and virtual-reality hardware, combined with NASA-oriented apps, will transform how NASA scientists and engineers work. Credit: NASA/W. Hrybyk

Although the computer-generated technology can trace its heritage to the 1980s with the advent electronic-gaming devices, it has advanced rapidly over the past 15 years, largely because of sophisticated computer technologies that render more realistic 3-D experiences and the decline in prices for headsets, handheld devices, and other gear.

"For several years, commercial VR and AR technology has been showing promise, but without real tangible results," said Ted Swanson, senior technologist for strategic integration for Goddard's Office of the Chief Technologist. "However, recently there have been substantial developments in VR/AR hardware and software that may allow us to use this technology for scientific and engineering applications."

The aim isn't to reinvent the hardware and software developed by technology companies, but to be a "consumer of the products and create NASA-oriented applications," he said.

The pilots, which involve students from the University of Maryland, College Park, and Bowie State University, also in Maryland, are as diverse as the specialties in which NASA excels, Swanson said.

Under one, Grubb and his university collaborators are creating a collaborative virtual-reality environment where users don headgear and use hand controls to design, assemble, and interact with spacecraft using pre-defined, off-the-shelf parts and virtual tools, such as wrenches and screwdrivers. "The collaborative capability is a major feature in VR," Grubb said. "Even though they may work at locations hundreds of miles apart, engineers could work together to build and evaluate designs in real-time due to the shared virtual environment. Problems could be found earlier, which would save NASA time and money."

In other engineering-related apps, the team has created a 3-D simulation of Goddard's thermal-vacuum chamber to help engineers determine whether all spacecraft components would fit inside the facility before testing begins. In another involving on-orbit robotic servicing, the augmented app combines camera views and telemetry data in one location—an important capability for technicians who operate robotic arms such as the one on the International Space Station. All information is within the operator's field of view, alerting them to potential problems before they happen.

A new virtual-reality application allows users to visualize the magnetic connections in Earth's magnetosphere. Credit: NASA

Just as important is applying the technology to scientific analysis, Grubb said.

The team has applied digital elevation maps and lidar data to create a 3-D simulation of terrestrial lava flows and tubes. The goal is to develop a proof-of-concept app that would allow scientists to compare remotely collected data with what they observe in the field. In another, the team is creating a 3-D visualization of space around the sun for mission planning. This simulation involves a constellation of CubeSats surrounding the sun to investigate the structure of the solar atmosphere, including the formation of coronal mass ejections that, when intense and traveling in the right direction, can affect low-Earth-orbiting spacecraft and power grids.

And last, the team is creating a environment where users can explore and visualize topographical features of Earth's protective magnetosphere. This app allows users to study magnetic reconnection sites, which are difficult to interpret without observations from more than one vantage point, Grubb said.

"I'm a gamer, but I see the potential for engineering and science applications," Grubb said. "We're in the early stages, but I believe this technology will transform how we work here. It will enhance engineering and give scientists a unique perspective of data."

Explore further: Microsoft aims at 'mixed reality' with new devices

Related Stories

Immersive virtual-reality creation software for everyone

May 9, 2017

Imverse, an EPFL spinoff, has developed a software that lets users convert 360-degree images from 2-D into 3-D and both manipulate and create virtual-reality content in real time with the help of virtual-reality glasses. ...

Apple quietly working on virtual reality: report

January 29, 2016

Apple has a team secretly working on virtual and augmented reality gear in a budding challenge to Facebook-owned Oculus Rift and Microsoft HoloLens, the Financial Times reported on Friday.

Recommended for you

Ancient meteorite tells tales of Mars topography

May 24, 2018

By looking at an ancient Martian meteorite that landed in the Sahara Desert, Lawrence Livermore National Laboratory (LLNL) scientists and collaborators have determined how and when the red planet's crustal topographic and ...

Rosetta unravels formation of sunrise jets

May 23, 2018

The atmosphere of Rosetta's comet 67P/Churyumov-Gerasimenko is far from homogeneous. In addition to sudden outbursts of gas and dust, daily recurring phenomena at sunrise can be observed. In these, evaporating gas and entrained ...

Drilling success: Curiosity is collecting Mars rocks

May 23, 2018

Engineers working with NASA's Curiosity Mars rover have been hard at work testing a new way for the rover to drill rocks and extract powder from them. This past weekend, that effort produced the first drilled sample on Mars ...

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.