Cell Phones Using Gesture Control (w/ Video)

Apr 29, 2010 by John Messina weblog

(PhysOrg.com) -- The next generation of cell phone interfaces is currently under development at Ishikawa Komuro Laboratory at the University of Tokyo but instead of using a touchscreen the new interface is touchless.

This new technology will use a high-speed on the to track user finger movements and . The advantage to this type of interface is that movements and gestures are only limited by the camera’s field of vision.

This video is not supported by your browser at this time.

A gesture that is similar to clicking a mouse button is defined as a movement towards the camera’s optical axis. This detection uses a frequency filter that is applied to a scale change in the fingertip image. This technique would also used for typing, selecting and zooming in-and-out on images without ever touching the screen.

The hardware that makes all this possible is a system which performs 3D motion tracking of human's hand and fingers from images of a single high-frame-rate camera and that recognizes typing motion in the air. The use of a high-frame-rate camera enables recognition of rapid typing motion that would otherwise be difficult to track using standard cameras.

Cell Phones Using Gesture Control (w/ Video)
Touchless Scrolling

Cell Phones Using Gesture Control (w/ Video)
Touchless Keyboard

In order for the camera to recognize real-time recognition, Ishikawa Komuro Laboratory developed hardware which parallelizes and accelerates image processing. They were able to achieve real-time recognition of typing motion with a throughput of 138 fps and a latency of 29 ms.

Ishikawa Komuro Laboratory hopes to commercialize their technology in the near future. There has been no mention of when this product will be available to consumers.

Explore further: Bringing history and the future to life with augmented reality

More information: www.k2.t.u-tokyo.ac.jp/members/komuro/terajima_chi2009.pdf

Related Stories

3DV Systems ZCam Revolutionizes Gaming & Electronics

Dec 15, 2007

3DV Systems has developed the ZCam. The camera is a low cost 3D PC camera that promises to revolutionize gaming and consumer electronics interfaces. It senses depth in real-time and has the capability of fine-gesture ...

TVs, Cell Phones to Learn 'Sign Language'

Jan 13, 2008

The days of pressing tangible buttons to operate TVs and cell phones may one day be replaced by waving, clapping, and pointing. With two upcoming products, Sony Ericsson´s Z555 gesture phone and JVC´s "Snap ...

Recommended for you

Patent talk: Google sharpens contact lens vision

Apr 16, 2014

(Phys.org) —A report from Patent Bolt brings us one step closer to what Google may have in mind in developing smart contact lenses. According to the discussion Google is interested in the concept of contact ...

Neuroscientist's idea wins new-toy award

Apr 15, 2014

When he was a child, Robijanto Soetedjo used to play with his electrically powered toys for a while and then, when he got bored, take them apart - much to the consternation of his parents.

Land Rover demos invisible bonnet / car hood (w/ video)

Apr 14, 2014

(Phys.org) —Land Rover has released a video demonstrating a part of its Discover Vision Concept—the invisible "bonnet" or as it's known in the U.S. the "hood" of the car. It's a concept the automaker ...

User comments : 3

Adjust slider to filter visible comments by rank

Display comments: newest first

LuckyBrandon
1 / 5 (2) Apr 29, 2010
im suprised voice to text hasnt become more wide spread...that is more useful to me than having "gesture control"...
powerup1
3 / 5 (2) Apr 29, 2010
sometime using your voice is not practical
gennoveus
not rated yet Apr 29, 2010
sometime using your voice is not practical


Indeed. Imagine a train/bus full of people all talking commands into their phones. It could get quite noisy!

Also, if two people were using the same model of phone in a small area (elevator for example), their phones might "hear" the other person's commands and inadvertently react to those commands.

I think this is a better idea, although I imagine that your fingers might get tired, especially at first.

More news stories

Hackathon team's GoogolPlex gives Siri extra powers

(Phys.org) —Four freshmen at the University of Pennsylvania have taken Apple's personal assistant Siri to behave as a graduate-level executive assistant which, when asked, is capable of adjusting the temperature ...

Better thermal-imaging lens from waste sulfur

Sulfur left over from refining fossil fuels can be transformed into cheap, lightweight, plastic lenses for infrared devices, including night-vision goggles, a University of Arizona-led international team ...

Deadly human pathogen Cryptococcus fully sequenced

Within each strand of DNA lies the blueprint for building an organism, along with the keys to its evolution and survival. These genetic instructions can give valuable insight into why pathogens like Cryptococcus ne ...