Researchers use 'digits' to change the channel

Nov 08, 2012
Change the channel with a wave of your hand
Credit: Newcastle University

A team of inventors from across Europe have done away with traditional remotes and have developed a sensor about the size of a wrist watch which is able to track the 3D movement of the hand and allows the user to remotely control any device. The researchers believe that their device could replace your television remote and games controller, and could even control your mobile phone - with just a wave of the hand. Their controller, 'Digits', was presented at the 25th Association for Computing Machinery Symposium on User Interface Software and Technology (ACM UIST).

Their invention represents a major breakthrough as it allows, for the first time, 3D interactions without being tied to any external hardware. maps finger movement and orientation and it gives the user remote control anytime, anywhere, according to its developers, even allowing you to answer your phone while it's still in your pocket and you're walking down the street.

Digits was developed by David Kim, a Microsoft Research (MSR)-funded PhD student from Newcastle University's Culture Lab; Otmar Hilliges, Shahram Izadi, Alex Butler and Jiawen Chen of MSR Cambridge; Iason Oikonomidis of Greece's Foundation for Research & Technology; and Professor Patrick Olivier of Newcastle University's Culture Lab.

'The Digits sensor doesn't rely on any external infrastructure so it is completely mobile,' explains David Kim. 'This means users are not bound to a fixed space. They can interact while moving from room to room or even running down the street. What Digits does is finally take 3-D interaction outside the living room.'

To fulfil their ambitious target, Digits had to be lightweight, have a small power consumption footprint, and have the potential to be as small and comfortable as a watch. At the same time they also wanted Digits to accomplish a lot, such as deliver superior gesture sensing and 'understand' the human hand, from wrist orientation to the angle of each finger joint, so that interaction would not be limited to 3D points in space. Digits had to understand what the hand is trying to express, even while inside a pocket.

David Kim adds: 'We needed a system that enabled natural 3-D interactions with bare hands, but with as much flexibility and accuracy as data gloves. We wanted users to be able to interact spontaneously with their electronic devices using simple gestures without even having to reach for them. Can you imagine how much easier it would be if you could answer your mobile phone while it's still in your pocket or buried at the bottom of your bag?'

Their prototype, which they showcased at the prestigious ACM UIST 2012 conference, includes an infrared (IR) camera, IR laser line generator, IR diffuse illuminator, and an inertial-measurement unit (IMU) track.

Shahram Izadi explains the challenges they had to overcome, such as extrapolating natural-looking hand motions from a sparse sampling of the key points sensed by the camera.

'We had to understand our own body parts first before we could formulate their workings mathematically,' Shahram Izadi explains. 'We spent hours just staring at our fingers. We read dozens of scientific papers about the biomechanical properties of the human hand. We tried to correlate these five points with the highly complex motion of the hand. In fact, we completely rewrote each kinematic model about three or four times until we got it just right.'

The team agrees that the most exciting moment of the project came when team members saw the models succeed. 'At the beginning, the virtual hand often broke and collapsed. It was always very painful to watch,' David Kim explains. 'Then, one day, we radically simplified the mathematical model, and suddenly, it behaved like a human hand. It felt absolutely surreal and immersive, like in the movie Avatar. That moment gave us a big boost!'

Digits is just the tip of the iceberg; the researchers are also experimenting to further develop their invention. 'By understanding how one part of the body works and knowing what sensors to use to capture a snapshot,' Shahram Izadi says, 'Digits offers a compelling look at the possibilities of opening up the full expressiveness and dexterity of one of our body parts for mobile human-computer interaction.'

Explore further: Patent talk: Google sharpens contact lens vision

add to favorites email to friend print save as pdf

Related Stories

Hand prosthetic gives teen new independence

Aug 25, 2011

( -- A 15 year old British girl, Chloe Holmes, has been in the news as being among the youngest in Europe to wear a special prosthetic hand with state of the art bionic fingers. The bionic digits ...

Researchers solve mystery of disappearing bird digit

Sep 04, 2011

Evolution adds and subtracts, and nowhere is this math more evident than in vertebrates, which are programmed to have five digits on each limb. But many species do not. Snakes, of course, have no digits, and ...

Recommended for you

Patent talk: Google sharpens contact lens vision

23 hours ago

( —A report from Patent Bolt brings us one step closer to what Google may have in mind in developing smart contact lenses. According to the discussion Google is interested in the concept of contact ...

Neuroscientist's idea wins new-toy award

Apr 15, 2014

When he was a child, Robijanto Soetedjo used to play with his electrically powered toys for a while and then, when he got bored, take them apart - much to the consternation of his parents.

Land Rover demos invisible bonnet / car hood (w/ video)

Apr 14, 2014

( —Land Rover has released a video demonstrating a part of its Discover Vision Concept—the invisible "bonnet" or as it's known in the U.S. the "hood" of the car. It's a concept the automaker ...

Visions of 1964 World's Fair didn't all come true

Apr 12, 2014

Video phone calls? Yeah, we do that. Asking computers for information? Sure, several times a day. Colonies on the moon and jet packs as a mode of everyday transportation. OK, maybe not.

User comments : 0

More news stories

Simplicity is key to co-operative robots

A way of making hundreds—or even thousands—of tiny robots cluster to carry out tasks without using any memory or processing power has been developed by engineers at the University of Sheffield, UK.

Microsoft CEO is driving data-culture mindset

( —Microsoft's future strategy: is all about leveraging data, from different sources, coming together using one cohesive Microsoft architecture. Microsoft CEO Satya Nadella on Tuesday, both in ...

Floating nuclear plants could ride out tsunamis

When an earthquake and tsunami struck the Fukushima Daiichi nuclear plant complex in 2011, neither the quake nor the inundation caused the ensuing contamination. Rather, it was the aftereffects—specifically, ...

Patent talk: Google sharpens contact lens vision

( —A report from Patent Bolt brings us one step closer to what Google may have in mind in developing smart contact lenses. According to the discussion Google is interested in the concept of contact ...

Quantenna promises 10-gigabit Wi-Fi by next year

( —Quantenna Communications has announced that it has plans for releasing a chipset that will be capable of delivering 10Gbps WiFi to/from routers, bridges and computers by sometime next year. ...