Eye-tracking software opens online worlds to people with disabilities (w/ Video)

June 24, 2009
Eye-tracking software opens online worlds to people with disabilities
Developing ways to issue commands to avatars using 'gaze gestures'. © COGAIN

(PhysOrg.com) -- Technology that allows gamers to control game functions with only their eyes is helping to open virtual worlds such as Second Life and World of Warcraft to people with severe motor disabilities.

The gaming-with-gaze software - a first version of which has been made publicly available for free - is one of several applications to emerge from COGAIN, an EU-funded network of excellence aimed at coordinating efforts from developers of new communications tools for people with disabilities using gaze and eye-tracking technology.

For people suffering from conditions such as cerebral palsy, (MND) or so-called locked-in syndromes, being able to move around and interact in a virtual environment is a “truly liberating experience,” says Howell Istance, a computer scientist who helped develop the software.

“Until now, gaze-tracking technology has mainly been used for typing with visual keyboards, for browsing the web and other text-based applications. We have taken it to an entirely new level by using eye movements to control an avatar in a , allowing people with disabilities to appear and interact just like able-bodied people if they wish,” explains Istance of De Montfort University in the United Kingdom.

The gaming-with-gaze software works in combination with commercially available eye trackers that use cameras to monitor users’ eye movements as they gaze at a computer screen. The developers studied the eye movements of able-bodied gamers to create a visual heat map in order to trigger commands depending on where users look. Different patterns of are translated into so-called gaze gestures that are used to trigger movement or action commands.

Glancing to the left or right will turn the virtual character in that direction, for example, while staring at the centre of the screen will make the avatar run forwards. Because the software is independent of the game itself, it can be used to play virtually any game that requires mouse and keyboard inputs.

Communicating with other players is made possible by gazing at letters on an onscreen visual keyboard, while different combinations of gestures can be used to perform different actions.

“In the current set up, we have programmed 12 gesture sequences to activate different keyboard or mouse events,” Istance says. “Many more commands are possible but the total number is limited by the users’ memory and the need to differentiate between when someone wants to input a command and when they are just looking at the screen.”

The approach contrasts with slower and more laborious gaze-based input techniques, which work sufficiently well for typing a message or surfing the internet but which are too slow and tiring to enable users to match the speed and accuracy needed to play real-time 3D games.

Life-changing experience

The gaming-with-gaze software should make the avatars of people with disabilities almost indistinguishable in their behaviour and abilities from those of able-bodied people in online games and environments.

“It could be life changing for the large number of paralysed people whose only means of communicating is with their eyes. Second Life, for example, could really be a second life for them, providing not only entertainment but versatile electronic services, for example, education,” says Aulikki Hyrskykari, a researcher at Tampere University.

”Obviously there will be limitations to what users with disabilities can do - such as not being able to perform several actions simultaneously - but they can choose what activities they participate in. That is a choice they did not have before,” Istance adds.

The free software was made available to download on 26 May, coinciding with an annual public conference in Copenhagen organised by participants in the COGAIN network.

The researchers plan to encourage with disabilities who are already using eye-tracking systems to install the software and use it with whatever online games they would like to play.

Another team of researchers working in the COGAIN network developed free software to turn a high-definition video camera into an eye-tracker, providing a low-cost alternative to expensive commercial systems.

“Based on the feedback we received, we will continue to develop the gaming software,” Istance says. “The goal is to have a single version of the that is flexible enough to adapt to the interface of any online game and to the requirements and limitations of any user.”

More information: www.cogain.org/

Gaming-with-gaze software download: www.cogain.org/downloads/leisu … ications/snapclutch/

Provided by ICT Results

Explore further: An affordable future for eye tracking in sight

Related Stories

An affordable future for eye tracking in sight

April 3, 2006

An ambitious five-year project will attempt to make eye-tracking technologies more affordable for people with disabilities and extend the potential use of the devices to enable users to live more independently.

Two Robot Chefs Make Omelets

December 4, 2008

(PhysOrg.com) -- No "house of the future" is complete without a household robot to do the cooking and cleaning. Although today´s robots still have a ways to go before substituting for a real live-in maid, researchers are ...

A (virtual) smart home controlled by your thoughts

May 11, 2009

Light switches, TV remote controls and even house keys could become a thing of the past thanks to brain-computer interface (BCI) technology being developed in Europe that lets users perform everyday tasks with thoughts alone.

Recommended for you

Researchers find tweeting in cities lower than expected

February 20, 2018

Studying data from Twitter, University of Illinois researchers found that less people tweet per capita from larger cities than in smaller ones, indicating an unexpected trend that has implications in understanding urban pace ...

Augmented reality takes 3-D printing to next level

February 20, 2018

Cornell researchers are taking 3-D printing and 3-D modeling to a new level by using augmented reality (AR) to allow designers to design in physical space while a robotic arm rapidly prints the work.


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.