NASA develops Augmented Reality headset for commercial pilots

Mar 15, 2012 by Bob Yirka report
Image: NASA

( -- NASA’s Langley Research Center in Virginia has been hard at work developing an Augmented Reality headset for use by commercial pilots to help reduce airline accidents due to poor weather and overcrowding at airports. The results of that effort have now become known as NASA has recently begun searching for a company to make and market the headset which thus far, doesn’t have an official name.

Augmented reality is where computer generated images are projected onto a piece of glass that the user looks through. In so doing, the user can see both the real world and the images that are displayed, which are tied to real world objects. An AR device for commercial pilots for example could display what looks like the actual runway (and tower, other planes, etc.) as a plane approaches for landing in fog. Once on the ground, it could display the runway centerline, as well as interconnecting runways, and the taxi pathway that is supposed to be followed. Because most commercial plane accidents occur during landing, takeoff or when taxiing, more focus has been aimed at providing tools to pilots to help them better see what is going on.

The new AR headset is designed to do just that. It fits over the head, and has one eyepiece that the pilot looks through. It also uses gyroscopes and sensors that read pieces of paper placed on cabin walls to orient itself so that it can correctly interpret which direction the pilot is looking and respond accordingly. It also includes voice recognition software to allow the pilot to communicate with the system orally.

Examples of Synthetic Vision System Displays. Image: NASA

The system is similar in some respects to AR headsets worn by pilots of military jets and helicopters and is an improvement over current headsets used on some commercial flights that overlay information in front of the pilot, but aren’t tied to the real world. None of the technology in the headset is new, and in fact all of the information they provide to a pilot is now currently available. The difference is the headset will allow the pilot to keep his or her eyes focused on where the plane is heading, rather than having to look away to study maps or electronic devices.

The AR is part of a larger effort by to improve visualization for pilots, called Synthetic Vision. The idea is to eventually move imagery to the windshield in a way that is both informative and free of unnecessary clutter that could get in the way of actually flying the plane.

Explore further: Patent talk: Google sharpens contact lens vision

Related Stories

Automation in the air dulls pilot skill

Aug 30, 2011

(AP) -- Safety and industry officials worry that there will be more deadly airline accidents traced to pilots who have lost their hands-on instincts as planes become ever more reliant on automation to navigate ...

NASA testing a 'clear view' for pilots

Oct 05, 2005

NASA officials in Washington say they are working on a project to make flying safer by electronically giving pilots a clear view of their surroundings.

Augmented Reality: Science Fiction or Reality? (w/ Video)

Jul 07, 2009

( -- Computer graphics have come a long way since the birth of Atari Games over 30 years ago. Today, computer graphics seem very real and some day researchers will pull graphics out of your television ...

Virtual reality in a Michigan Tech lab

Mar 07, 2011

I am in Room 314 in Rekhi Hall, arms spread wide, tippy-toeing across a rickety board and trying oh-so-hard not to fall into a gaping hole beneath my feet. One misstep and I join the dead cow at the bottom ...

Recommended for you

Patent talk: Google sharpens contact lens vision

Apr 16, 2014

( —A report from Patent Bolt brings us one step closer to what Google may have in mind in developing smart contact lenses. According to the discussion Google is interested in the concept of contact ...

Neuroscientist's idea wins new-toy award

Apr 15, 2014

When he was a child, Robijanto Soetedjo used to play with his electrically powered toys for a while and then, when he got bored, take them apart - much to the consternation of his parents.

Land Rover demos invisible bonnet / car hood (w/ video)

Apr 14, 2014

( —Land Rover has released a video demonstrating a part of its Discover Vision Concept—the invisible "bonnet" or as it's known in the U.S. the "hood" of the car. It's a concept the automaker ...

Visions of 1964 World's Fair didn't all come true

Apr 12, 2014

Video phone calls? Yeah, we do that. Asking computers for information? Sure, several times a day. Colonies on the moon and jet packs as a mode of everyday transportation. OK, maybe not.

User comments : 7

Adjust slider to filter visible comments by rank

Display comments: newest first

5 / 5 (3) Mar 15, 2012
"Augmented reality is where computer generated images are projected onto a piece of glass that the user looks through."
A popular alternative that has been tested is direct retinal projection, which requires significantly less energy, and could result in significantly lower profile units. Additionally I wonder how much of the computing components are in the headset itself, and if they could be moved to something worn on the waist, connected by a thin cable. The less mass worn on the head the better.
4 / 5 (1) Mar 15, 2012
It'll be a shame when kids born in 2050 are so accustomed to this type of next-gen technology that THEY GO BLIND! *ominous hand waving *aahhwoo0o0o0oo*
It will be the backlash over GameBoy and it's new DS system all over again! God(doctor) knows I've ruined my vision on my laptop :(
2.3 / 5 (6) Mar 15, 2012
Boris Malingerowsky was arrested this morning for hacking into flight UA2315's AR system. The heavily laden 767 landed in heavy fog in the lagoon on Bora Bora attol identifying it instead as Hartsfield-Jackson International Airport in Atlanta. Passengers were rescued by local inhabitants with outrigger canoes while many managed to remain adrift using coconuts.
1 / 5 (3) Mar 16, 2012
If they really want to accelerate funding for this project, all they need to do is create a civilian version as a game accessory. They'd clean up in a matter of months; and I'd be first in line to buy one.
3 / 5 (4) Mar 16, 2012
This is gonna take wanking to a whole new level.

Oh good Lord, did I say that out loud???
not rated yet Mar 16, 2012
Wouldn't be easier to just put something like Samsung transparent TV in one of front windows in the plane?? With predetermine transparency level say 15%-20%, screen would be connected to on board GPS system, fiber optic gyrocompass and on board radar system for maintaining plane position. Before landing system would connect with airport ground control with would sent live time positions of other plains that are on ground taxiing.
not rated yet Mar 16, 2012
I've been suggesting this for years. Ever since VR came about. We just didn't have the technology then. But now we've got the ability to make these small, handheld wireless devices linked to lightweight optical devices. Gaming would no longer be an excuse for lazy bastards to get fat on the couch.

More news stories

Simplicity is key to co-operative robots

A way of making hundreds—or even thousands—of tiny robots cluster to carry out tasks without using any memory or processing power has been developed by engineers at the University of Sheffield, UK.

Microsoft CEO is driving data-culture mindset

( —Microsoft's future strategy: is all about leveraging data, from different sources, coming together using one cohesive Microsoft architecture. Microsoft CEO Satya Nadella on Tuesday, both in ...

Floating nuclear plants could ride out tsunamis

When an earthquake and tsunami struck the Fukushima Daiichi nuclear plant complex in 2011, neither the quake nor the inundation caused the ensuing contamination. Rather, it was the aftereffects—specifically, ...

New clinical trial launched for advance lung cancer

Cancer Research UK is partnering with pharmaceutical companies AstraZeneca and Pfizer to create a pioneering clinical trial for patients with advanced lung cancer – marking a new era of research into personalised medicines ...

More vets turn to prosthetics to help legless pets

A 9-month-old boxer pup named Duncan barreled down a beach in Oregon, running full tilt on soft sand into YouTube history and showing more than 4 million viewers that he can revel in a good romp despite lacking ...