NASA develops Augmented Reality headset for commercial pilots

March 15, 2012 by Bob Yirka, report

Image: NASA
( -- NASA’s Langley Research Center in Virginia has been hard at work developing an Augmented Reality headset for use by commercial pilots to help reduce airline accidents due to poor weather and overcrowding at airports. The results of that effort have now become known as NASA has recently begun searching for a company to make and market the headset which thus far, doesn’t have an official name.

Augmented reality is where computer generated images are projected onto a piece of glass that the user looks through. In so doing, the user can see both the real world and the images that are displayed, which are tied to real world objects. An AR device for commercial pilots for example could display what looks like the actual runway (and tower, other planes, etc.) as a plane approaches for landing in fog. Once on the ground, it could display the runway centerline, as well as interconnecting runways, and the taxi pathway that is supposed to be followed. Because most commercial plane accidents occur during landing, takeoff or when taxiing, more focus has been aimed at providing tools to pilots to help them better see what is going on.

The new AR headset is designed to do just that. It fits over the head, and has one eyepiece that the pilot looks through. It also uses gyroscopes and sensors that read pieces of paper placed on cabin walls to orient itself so that it can correctly interpret which direction the pilot is looking and respond accordingly. It also includes voice recognition software to allow the pilot to communicate with the system orally.

Examples of Synthetic Vision System Displays. Image: NASA

The system is similar in some respects to AR headsets worn by pilots of military jets and helicopters and is an improvement over current headsets used on some commercial flights that overlay information in front of the pilot, but aren’t tied to the real world. None of the technology in the headset is new, and in fact all of the information they provide to a pilot is now currently available. The difference is the headset will allow the pilot to keep his or her eyes focused on where the plane is heading, rather than having to look away to study maps or electronic devices.

The AR is part of a larger effort by to improve visualization for pilots, called Synthetic Vision. The idea is to eventually move imagery to the windshield in a way that is both informative and free of unnecessary clutter that could get in the way of actually flying the plane.

Explore further: Automation in the air dulls pilot skill

Related Stories

Automation in the air dulls pilot skill

August 30, 2011

(AP) -- Safety and industry officials worry that there will be more deadly airline accidents traced to pilots who have lost their hands-on instincts as planes become ever more reliant on automation to navigate crowded skies.

NASA testing a 'clear view' for pilots

October 5, 2005

NASA officials in Washington say they are working on a project to make flying safer by electronically giving pilots a clear view of their surroundings.

Augmented Reality: Science Fiction or Reality? (w/ Video)

July 7, 2009

( -- Computer graphics have come a long way since the birth of Atari Games over 30 years ago. Today, computer graphics seem very real and some day researchers will pull graphics out of your television or computer ...

Virtual reality in a Michigan Tech lab

March 7, 2011

I am in Room 314 in Rekhi Hall, arms spread wide, tippy-toeing across a rickety board and trying oh-so-hard not to fall into a gaping hole beneath my feet. One misstep and I join the dead cow at the bottom of the pit.

Recommended for you


Adjust slider to filter visible comments by rank

Display comments: newest first

Mar 15, 2012
This comment has been removed by a moderator.
5 / 5 (3) Mar 15, 2012
"Augmented reality is where computer generated images are projected onto a piece of glass that the user looks through."
A popular alternative that has been tested is direct retinal projection, which requires significantly less energy, and could result in significantly lower profile units. Additionally I wonder how much of the computing components are in the headset itself, and if they could be moved to something worn on the waist, connected by a thin cable. The less mass worn on the head the better.
4 / 5 (1) Mar 15, 2012
It'll be a shame when kids born in 2050 are so accustomed to this type of next-gen technology that THEY GO BLIND! *ominous hand waving *aahhwoo0o0o0oo*
It will be the backlash over GameBoy and it's new DS system all over again! God(doctor) knows I've ruined my vision on my laptop :(
2.3 / 5 (6) Mar 15, 2012
Boris Malingerowsky was arrested this morning for hacking into flight UA2315's AR system. The heavily laden 767 landed in heavy fog in the lagoon on Bora Bora attol identifying it instead as Hartsfield-Jackson International Airport in Atlanta. Passengers were rescued by local inhabitants with outrigger canoes while many managed to remain adrift using coconuts.
1 / 5 (3) Mar 16, 2012
If they really want to accelerate funding for this project, all they need to do is create a civilian version as a game accessory. They'd clean up in a matter of months; and I'd be first in line to buy one.
3 / 5 (4) Mar 16, 2012
This is gonna take wanking to a whole new level.

Oh good Lord, did I say that out loud???
not rated yet Mar 16, 2012
Wouldn't be easier to just put something like Samsung transparent TV in one of front windows in the plane?? With predetermine transparency level say 15%-20%, screen would be connected to on board GPS system, fiber optic gyrocompass and on board radar system for maintaining plane position. Before landing system would connect with airport ground control with would sent live time positions of other plains that are on ground taxiing.
not rated yet Mar 16, 2012
I've been suggesting this for years. Ever since VR came about. We just didn't have the technology then. But now we've got the ability to make these small, handheld wireless devices linked to lightweight optical devices. Gaming would no longer be an excuse for lazy bastards to get fat on the couch.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.