Researchers develop low-cost device to control computer with your eyes (w/ Video)

Jul 12, 2012
A version of Pong is played on the original Magnovox Odyssey 200 in 2009. Engineers said Friday they had built a device using mass-produced video gaming equipment that lets disabled people control a computer with just their eyes -- with a price tag of under $30 (25 euros). To demonstrate their gadget's functionality, the team got subjects to play the video game Pong.

Millions of people suffering from Multiple Sclerosis, Parkinson's, muscular dystrophy, spinal cord injuries or amputees could soon interact with their computers and surroundings using just their eyes, thanks to a new device that costs less than £40.

Composed from off-the-shelf materials, the new device can work out exactly where a person is looking by tracking their eye movements, allowing them to control a cursor on a screen just like a normal computer mouse.

The technology comprises an eye-tracking device and "smart" software that have been presented today in the Journal of Neural Engineering. Researchers from Imperial College London demonstrated its functionality by getting a group of people to play the classic computer game Pong without any kind of handset. In addition users were able to browse the web and write emails "hands-off".

This video is not supported by your browser at this time.
A video of somebody using the device to play Pong

The GT3D device is made up of two fast video game console cameras, costing less than £20 each, that are attached, outside of the line of vision, to a pair of glasses that cost just £3. The cameras constantly take pictures of the eye, working out where the pupil is pointing, and from this the researchers can use a set of calibrations to work out exactly where a person is looking on the screen.

Even more impressively, the researchers are also able to use more detailed calibrations to work out the 3D gaze of the subjects – in other words, how far into the distance they were looking. It is believed that this could allow people to control an electronic wheelchair simply by looking where they want to go or control a robotic prosthetic arm.

To demonstrate the effectiveness of the eye-tracker, the researchers got subjects to play the video game Pong. In this game, the subject used his or her eyes to move a bat to hit a ball that was bouncing around the screen – a feat that is difficult to accomplish with other read-out mechanisms such as brain waves (EEG).

Dr Aldo Faisal, Lecturer in Neurotechnology at Imperial's Department of Bioengineering and the Department of Computing, is confident in the ability to utilise eye movements given that six of the subjects, who had never used their eyes as a control input before, could still register a respectable score within 20 per cent of the able bodied users after just 10 minutes of using the device for the first time.

The commercially viable device uses just one watt of power and can transmit data wirelessly over Wi-Fi or via USB into any Windows or Linux computer.

The GT3D system has also solved the 'Midas touch problem', allowing users to click on an item on the screen using their eyes, instead of a mouse button.

This problem has previously been resolved by staring at an icon for a prolonged period or blinking; however, the latter is part of our natural behaviour and happens unintentionally. Instead, the researchers calibrated the system so that a simple wink would represent a mouse click, which only occurs voluntarily unlike the blink.

Dr Faisal said: "Crucially, we have achieved two things: we have built a 3D eye tracking system hundreds of times cheaper than commercial systems and used it to build a real-time brain machine interface that allows patients to interact more smoothly and more quickly than existing invasive technologies that are tens of thousands of times more expensive.

"This is frugal innovation; developing smarter software and piggy-backing existing hardware to create devices that can help people worldwide independent of their healthcare circumstances."

Explore further: Chinese scientists unveil liquid phase 3-D printing method using low melting metal alloy ink

More information: "Ultra low-cost 3D gaze estimation: an intuitive high information throughput complement to direct brain–machine interfaces" Abbott W W and Faisal A A 2012 J. Neural Eng. 9 046016. iopscience.iop.org/1741-2552/9/4/046016

Related Stories

Playing 'Pong' with the blink of an eye (w/ Video)

Mar 26, 2010

University students have developed a computer game that is operated by eye movements, which could allow people with severe physical disabilities to become 'gamers' for the first time, they announce today.

An affordable future for eye tracking in sight

Apr 03, 2006

An ambitious five-year project will attempt to make eye-tracking technologies more affordable for people with disabilities and extend the potential use of the devices to enable users to live more independently.

Recommended for you

Researchers solves Gold Coast light rail noise issues

Sep 29, 2014

Lessons learned through Monash University research into the reduction of wheel squeal noise of trains in Hong Kong has assisted the GoldLinQ consortium to resolve noise problems with the new Gold Coast light ...

User comments : 1

Adjust slider to filter visible comments by rank

Display comments: newest first

Bowler_4007
not rated yet Jul 12, 2012
i wouldn't put that on my face sort out the bulk and you have a piece of tech that would not only help out disabled people but would be a novelty to others