Gesture recognition

Dec 18, 2008

A system that can recognize human gestures could provide a new way for people with physical disabilities to interact with computers. A related system for the able bodied could also be used to make virtual worlds more realistic. The system is described in detail in a forthcoming issue of the International Journal of Arts and Technology.

Manolya Kavakli of the Virtual and Interactive Simulations of Reality Research Group, at Macquarie University, Sydney, Australia, explains how standard input devices - keyboard and computer mouse, do not closely mimic natural hand motions such as drawing and sketching. Moreover, these devices have not been developed for ergonomic use nor for people with disabilities.

She and her colleagues have developed a computer system architecture that can carry out "gesture recognition". In this system, the person wears "datagloves" which have illuminated LEDs that are tracked by two pairs of computer webcams working to produce an all-round binocular view. This allows the computer to monitor the person's hand or shoulder movements. This input can then be fed to a program, a game, or simulator, or to control a character, an avatar, in a 3D virtual environment.

"We developed two gesture recognition systems: DESigning In virtual Reality (DesIRe) and DRiving for disabled (DRive). DesIRe allows any user to control dynamically in real-time simulators or other programs. DRive allows a quadriplegic person to control a car interface using input from just two LEDs on an over-shoulder garment. For more precise gestures, a DataGlove user can gesture using their fingers.

The system architecture include the following components: Vizard Virtual Reality Toolkit, an immersive projection system (VISOR), an optical tracking system (specifically the Precision Position Tracker (PPT) system) and a data input system, Kavakli explains. The DataGlove input is quite simplistic at the moment, but future work will lead to an increase in sensitivity to specific gestures, such as grasping, strumming, stroking, and other hand movements.

Source: Inderscience Publishers

Explore further: Reflected smartphone transmissions enable gesture control

add to favorites email to friend print save as pdf

Related Stories

The virtual keyboard may soon be a reality (w/ Video)

May 07, 2014

Today we are constantly online and integrated in a virtual existence. Wii and other game modules make it possible to engage the entire body when playing, and soon Google Glasses and similar products will ...

Writing without keyboard: Handwriting recognition on the wrist

Feb 21, 2013

Typing text messages on the mobile phone via the tiny soft keyboard is very cumbersome. How about simply writing it into the air! This idea drove the development of "airwriting" made by computer scientists of Karlsruhe Institute ...

NEC unveils gesture controlling device

May 16, 2012

Japanese technology titan NEC has unveiled a gadget that allows users to control their TV, mobile phone or tablet computer using a virtual input device.

Recommended for you

Oculus unveils new prototype VR headset

10 hours ago

Oculus has unveiled a new prototype of its virtual reality headset. However, the VR company still isn't ready to release a consumer edition.

Wireless sensor transmits tumor pressure

17 hours ago

The interstitial pressure inside a tumor is often remarkably high compared to normal tissues and is thought to impede the delivery of chemotherapeutic agents as well as decrease the effectiveness of radiation ...

Tim Cook puts personal touch on iPhone 6 launch

18 hours ago

Apple chief Tim Cook personally kicked off sales of the iPhone 6, joining in "selfies" and shaking hands with customers Friday outside the company's store near his Silicon Valley home.

Team improves solar-cell efficiency

Sep 19, 2014

New light has been shed on solar power generation using devices made with polymers, thanks to a collaboration between scientists in the University of Chicago's chemistry department, the Institute for Molecular ...

Calif. teachers fund to boost clean energy bets

Sep 19, 2014

The California State Teachers' Retirement System says it plans to increase its investments in clean energy and technology to $3.7 billion, from $1.4 billion, over the next five years.

User comments : 0