Gesture recognition

December 18, 2008

A system that can recognize human gestures could provide a new way for people with physical disabilities to interact with computers. A related system for the able bodied could also be used to make virtual worlds more realistic. The system is described in detail in a forthcoming issue of the International Journal of Arts and Technology.

Manolya Kavakli of the Virtual and Interactive Simulations of Reality Research Group, at Macquarie University, Sydney, Australia, explains how standard input devices - keyboard and computer mouse, do not closely mimic natural hand motions such as drawing and sketching. Moreover, these devices have not been developed for ergonomic use nor for people with disabilities.

She and her colleagues have developed a computer system architecture that can carry out "gesture recognition". In this system, the person wears "datagloves" which have illuminated LEDs that are tracked by two pairs of computer webcams working to produce an all-round binocular view. This allows the computer to monitor the person's hand or shoulder movements. This input can then be fed to a program, a game, or simulator, or to control a character, an avatar, in a 3D virtual environment.

"We developed two gesture recognition systems: DESigning In virtual Reality (DesIRe) and DRiving for disabled (DRive). DesIRe allows any user to control dynamically in real-time simulators or other programs. DRive allows a quadriplegic person to control a car interface using input from just two LEDs on an over-shoulder garment. For more precise gestures, a DataGlove user can gesture using their fingers.

The system architecture include the following components: Vizard Virtual Reality Toolkit, an immersive projection system (VISOR), an optical tracking system (specifically the Precision Position Tracker (PPT) system) and a data input system, Kavakli explains. The DataGlove input is quite simplistic at the moment, but future work will lead to an increase in sensitivity to specific gestures, such as grasping, strumming, stroking, and other hand movements.

Source: Inderscience Publishers

Explore further: Depth-sensing technology enhances games

Related Stories

NEC unveils gesture controlling device

May 16, 2012

Japanese technology titan NEC has unveiled a gadget that allows users to control their TV, mobile phone or tablet computer using a virtual input device.

Window shopping, virtually

January 5, 2011

Researchers want to make shopping trips a special experience in future by enabling passers-by to operate window displays with hand and facial gestures. Four cameras record the 3-D positions of people’s hands, face and ...

Leap Motion creates finger-happy gesture control (w/ Video)

May 23, 2012

(Phys.org) -- Developers and end users both have been indicating they are ready to start saying long goodbyes to mouse and keyboard. In this touchscreen generation of mobile users, the big stir among gadget reviewers this ...

The virtual keyboard may soon be a reality (w/ Video)

May 7, 2014

Today we are constantly online and integrated in a virtual existence. Wii and other game modules make it possible to engage the entire body when playing, and soon Google Glasses and similar products will open up a whole new ...

Recommended for you

Intelligent robots threaten millions of jobs

February 14, 2016

Advances in artificial intelligence will soon lead to robots that are capable of nearly everything humans do, threatening tens of millions of jobs in the coming 30 years, experts warned Saturday.

Tiny diatoms boast enormous strength

February 8, 2016

Diatoms are single-celled algae organisms, around 30 to 100 millionths of a meter in diameter, that are ubiquitous throughout the oceans. These creatures are encased within a hard shell shaped like a wide, flattened cylinder—like ...

Search engines will know what you want ... sooner

February 8, 2016

If you enter "Oklahoma" in a search engine, you might get a travelogue, news about the oil industry, Oklahoma State football scores or an article on Rodgers and Hammerstein musicals. What appears at the top of the list might ...

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.