NASA develops Augmented Reality headset for commercial pilots

Mar 15, 2012 by Bob Yirka report
Image: NASA

(PhysOrg.com) -- NASA’s Langley Research Center in Virginia has been hard at work developing an Augmented Reality headset for use by commercial pilots to help reduce airline accidents due to poor weather and overcrowding at airports. The results of that effort have now become known as NASA has recently begun searching for a company to make and market the headset which thus far, doesn’t have an official name.

Augmented reality is where computer generated images are projected onto a piece of glass that the user looks through. In so doing, the user can see both the real world and the images that are displayed, which are tied to real world objects. An AR device for commercial pilots for example could display what looks like the actual runway (and tower, other planes, etc.) as a plane approaches for landing in fog. Once on the ground, it could display the runway centerline, as well as interconnecting runways, and the taxi pathway that is supposed to be followed. Because most commercial plane accidents occur during landing, takeoff or when taxiing, more focus has been aimed at providing tools to pilots to help them better see what is going on.

The new AR headset is designed to do just that. It fits over the head, and has one eyepiece that the pilot looks through. It also uses gyroscopes and sensors that read pieces of paper placed on cabin walls to orient itself so that it can correctly interpret which direction the pilot is looking and respond accordingly. It also includes voice recognition software to allow the pilot to communicate with the system orally.

Examples of Synthetic Vision System Displays. Image: NASA

The system is similar in some respects to AR headsets worn by pilots of military jets and helicopters and is an improvement over current headsets used on some commercial flights that overlay information in front of the pilot, but aren’t tied to the real world. None of the technology in the headset is new, and in fact all of the information they provide to a pilot is now currently available. The difference is the headset will allow the pilot to keep his or her eyes focused on where the plane is heading, rather than having to look away to study maps or electronic devices.

The AR is part of a larger effort by to improve visualization for pilots, called Synthetic Vision. The idea is to eventually move imagery to the windshield in a way that is both informative and free of unnecessary clutter that could get in the way of actually flying the plane.

Explore further: Reflected smartphone transmissions enable gesture control

Related Stories

Automation in the air dulls pilot skill

Aug 30, 2011

(AP) -- Safety and industry officials worry that there will be more deadly airline accidents traced to pilots who have lost their hands-on instincts as planes become ever more reliant on automation to navigate ...

NASA testing a 'clear view' for pilots

Oct 05, 2005

NASA officials in Washington say they are working on a project to make flying safer by electronically giving pilots a clear view of their surroundings.

Augmented Reality: Science Fiction or Reality? (w/ Video)

Jul 07, 2009

(PhysOrg.com) -- Computer graphics have come a long way since the birth of Atari Games over 30 years ago. Today, computer graphics seem very real and some day researchers will pull graphics out of your television ...

Virtual reality in a Michigan Tech lab

Mar 07, 2011

I am in Room 314 in Rekhi Hall, arms spread wide, tippy-toeing across a rickety board and trying oh-so-hard not to fall into a gaping hole beneath my feet. One misstep and I join the dead cow at the bottom ...

Recommended for you

Oculus unveils new prototype VR headset

10 hours ago

Oculus has unveiled a new prototype of its virtual reality headset. However, the VR company still isn't ready to release a consumer edition.

Wireless sensor transmits tumor pressure

16 hours ago

The interstitial pressure inside a tumor is often remarkably high compared to normal tissues and is thought to impede the delivery of chemotherapeutic agents as well as decrease the effectiveness of radiation ...

Tim Cook puts personal touch on iPhone 6 launch

18 hours ago

Apple chief Tim Cook personally kicked off sales of the iPhone 6, joining in "selfies" and shaking hands with customers Friday outside the company's store near his Silicon Valley home.

Team improves solar-cell efficiency

Sep 19, 2014

New light has been shed on solar power generation using devices made with polymers, thanks to a collaboration between scientists in the University of Chicago's chemistry department, the Institute for Molecular ...

Calif. teachers fund to boost clean energy bets

Sep 19, 2014

The California State Teachers' Retirement System says it plans to increase its investments in clean energy and technology to $3.7 billion, from $1.4 billion, over the next five years.

User comments : 7

Adjust slider to filter visible comments by rank

Display comments: newest first

Planapo
Mar 15, 2012
This comment has been removed by a moderator.
TrinityComplex
5 / 5 (3) Mar 15, 2012
"Augmented reality is where computer generated images are projected onto a piece of glass that the user looks through."
A popular alternative that has been tested is direct retinal projection, which requires significantly less energy, and could result in significantly lower profile units. Additionally I wonder how much of the computing components are in the headset itself, and if they could be moved to something worn on the waist, connected by a thin cable. The less mass worn on the head the better.
I_Dont_Have_A_Name
4 / 5 (1) Mar 15, 2012
It'll be a shame when kids born in 2050 are so accustomed to this type of next-gen technology that THEY GO BLIND! *ominous hand waving *aahhwoo0o0o0oo*
It will be the backlash over GameBoy and it's new DS system all over again! God(doctor) knows I've ruined my vision on my laptop :(
Tachyon8491
2.3 / 5 (6) Mar 15, 2012
Boris Malingerowsky was arrested this morning for hacking into flight UA2315's AR system. The heavily laden 767 landed in heavy fog in the lagoon on Bora Bora attol identifying it instead as Hartsfield-Jackson International Airport in Atlanta. Passengers were rescued by local inhabitants with outrigger canoes while many managed to remain adrift using coconuts.
Argiod
1 / 5 (3) Mar 16, 2012
If they really want to accelerate funding for this project, all they need to do is create a civilian version as a game accessory. They'd clean up in a matter of months; and I'd be first in line to buy one.
jscroft
3 / 5 (4) Mar 16, 2012
This is gonna take wanking to a whole new level.

Oh good Lord, did I say that out loud???
Infinity_
not rated yet Mar 16, 2012
Wouldn't be easier to just put something like Samsung transparent TV in one of front windows in the plane?? With predetermine transparency level say 15%-20%, screen would be connected to on board GPS system, fiber optic gyrocompass and on board radar system for maintaining plane position. Before landing system would connect with airport ground control with would sent live time positions of other plains that are on ground taxiing.
shockr
not rated yet Mar 16, 2012
I've been suggesting this for years. Ever since VR came about. We just didn't have the technology then. But now we've got the ability to make these small, handheld wireless devices linked to lightweight optical devices. Gaming would no longer be an excuse for lazy bastards to get fat on the couch.