Battery-free technology brings gesture recognition to all devices

Feb 27, 2014
Battery-free technology brings gesture recognition to all devices
AllSee detects the unique signal changes (shown on the oscilloscope) and classifies a rich set of hand gestures. Credit: U of Washington

Mute the song playing on your smartphone in your pocket by flicking your index finger in the air, or pause your "This American Life" podcast with a small wave of the hand. This kind of gesture control for electronics could soon become an alternative to touchscreens and sensing technologies that consume a lot of power and only work when users can see their smartphones and tablets.

University of Washington computer scientists have built a low-cost system that runs without batteries and lets users control their electronic devices hidden from sight with simple hand movements. The prototype, called "AllSee," uses existing TV signals as both a power source and the means for detecting a user's gesture command.

"This is the first gesture recognition system that can be implemented for less than a dollar and doesn't require a battery," said Shyam Gollakota, a UW assistant professor of computer science and engineering. "You can leverage TV signals both as a source of power and as a source of gesture recognition."

The technology is set to appear April 2-4 at the Symposium on Networked Systems Design and Implementation conference in Seattle.

The researchers built a small sensor that can be placed on an electronic device such as a smartphone. The sensor uses an ultra-low-power receiver to extract and classify gesture information from wireless transmissions around us. When a person gestures with the hand, it changes the amplitude of the wireless signals in the air. The AllSee sensors then recognize unique amplitude changes created by specific gestures.

Battery-free technology brings gesture recognition to all devices
The AllSee prototype is integrated with an off-the-shelf mobile phone. This technology enables new applications such as gesture recognition with the phone still in your pocket. Credit: U of Washington

Sensors use three to four times less power than existing gesture recognition systems by harvesting power from wireless transmissions. This allows for to always have the gesture technology on and enabled.

Gesture recognition already is possible on some mobile devices, including the Samsung Galaxy S4 smartphone. But users have to first manually enable the feature and be able to see the device for the gesture technology to work, and if left on, the gesture system quickly drains the phone's battery. In contrast, AllSee consumes only tens of microwatts of power and can always be left on. The user could gesture at the phone in a pocket or handbag to change the volume or mute the phone without having to touch or see the phone.

This technology could allow sensors to be attached to household electronics, making it possible to interact with everyday objects using gestures and also connect them to the Internet and to each other in an "Internet of Things" world.

"Beyond mobile devices, AllSee can enable interaction with Internet of Things devices. These sensing devices are increasingly smaller electronics that can't operate with usual keypads, so gesture-based systems are ideal," said Bryce Kellogg, a UW doctoral student in electrical engineering.

The UW team tested AllSee's capabilities on smartphones and battery-free sensors using eight different hand gestures such as pushing or pulling to zoom in and out. The prototype could correctly identify the gestures more than 90 percent of the time while performed more than 2 feet away from the device.

Battery-free technology brings gesture recognition to all devices
Beyond mobile devices, AllSee can also enable interaction with Internet of Things devices such as home monitoring solutions. Credit: U of Washington

Researchers have tested the technology for response time and whether it can distinguish between other motions and those directed at it. They found that the technology's response time is less than 80 microseconds, which is 1,000 times faster than blinking an eye.

"This enables a seamless and interactive experience for the user," said Vamsi Talla, a UW doctoral student in electrical engineering. The researchers also designed a wake-up gesture that allows the system not to confuse unintentional motions for actual gestures.

This video is not supported by your browser at this time.

This technology builds on previous work by Gollakota on leveraging Wi-Fi signals around us for gesture recognition around the home. Prior wireless gesture recognition techniques, however, consume tens of watts of power and aren't suitable for mobile or Internet of Things devices.

Explore further: Touch- and gesture-based input to support field work

add to favorites email to friend print save as pdf

Related Stories

Touch- and gesture-based input to support field work

Feb 18, 2014

Fujitsu Laboratories today announced that it has developed a wearable device in the form of a glove, equipped with a Near Field Communication (NFC) tag reader and that features gesture-based input for maintenance ...

Recommended for you

Cyclist's helmet, Volvo car to communicate for safety

9 hours ago

Volvo calls it "a wearable life-saving wearable cycling tech concept." The car maker is referring to a connected car and helmet prototype that enables two-way communication between Volvo drivers and cyclists ...

California puzzles over safety of driverless cars

9 hours ago

California's Department of Motor Vehicles will miss a year-end deadline to adopt new rules for cars of the future because regulators first have to figure out how they'll know whether "driverless" vehicles ...

Cadillac CT6 will get streaming video mirror

Dec 20, 2014

Cadillac said Thursday it will add high resolution streaming video to the function of a rearview mirror, so that the driver's vision and safety can be enhanced. The technology will debut on the 2016 Cadillac ...

Poll: Americans skeptical of commercial drones (Update)

Dec 19, 2014

Americans broadly back tight regulations on commercial drone operators, according to a new Associated Press-GfK poll, as concerns about privacy and safety override the potential benefits of the heralded drone ...

Cheaper, more powerful VR system for engineers

Dec 17, 2014

It's like a scene from a gamer's wildest dreams: 12 high-definition, 55-inch 3D televisions all connected to a computer capable of supporting high-end, graphics-intensive gaming.

User comments : 0

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.