Revolutionary technology enables objects to know how they are being touched (w/ Video)

May 04, 2012

A doorknob that knows whether to lock or unlock based on how it is grasped, a smartphone that silences itself if the user holds a finger to her lips and a chair that adjusts room lighting based on recognizing if a user is reclining or leaning forward are among the many possible applications of Touché, a new sensing technique developed by a team at Disney Research, Pittsburgh, and Carnegie Mellon University.

Touché is a form of capacitive touch sensing, the same principle underlying the types of touchscreens used in most smartphones. But instead of sensing electrical signals at a single frequency, like the typical touchscreen, Touché monitors capacitive signals across a broad range of frequencies.

This Swept Frequency Capacitive Sensing (SFCS) makes it possible to not only detect a "touch event," but to recognize complex configurations of the hand or body that is doing the touching. An object thus could sense how it is being touched, or might sense the body configuration of the person doing the touching.

SFCS is robust and can enhance everyday objects by using just a single sensing electrode. Sometimes, as in the case of a doorknob or other conductive objects, the object itself can serve as a sensor and no modifications are required. Even the human body or a body of water can be a sensor.

"Signal frequency sweeps have been used for decades in wireless communication, but as far as we know, nobody previously has attempted to apply this technique to touch interaction," said Ivan Poupyrev, senior research scientist at Disney Research, Pittsburgh. "Yet, in our laboratory experiments, we were able to enhance a broad variety of objects with high-fidelity touch sensitivity. When combined with gesture recognition techniques, Touché demonstrated recognition rates approaching 100 percent. That suggests it could immediately be used to create new and exciting ways for people to interact with objects and the world at large."

In addition to Poupyrev, the research team included Chris Harrison, a Ph.D. student in Carnegie Mellon's Human-Computer Interaction Institute, and Munehiko Sato, a Disney intern and a Ph.D. student in engineering at the University of Tokyo. The researchers will present their findings May 7 at CHI 2012, the Conference on Human Factors in Computing Systems, in Austin, Texas, where it has been recognized with a prestigious Best Paper Award.

This video is not supported by your browser at this time.

Both Touché and smartphone touchscreens are based on the phenomenon known as capacitive coupling. In a capacitive touchscreen, the surface is coated with a transparent conductor that carries an electrical signal. That signal is altered when a person's finger touches it, providing an alternative path for the electrical charge. By monitoring the change in the signal, the device can determine if a touch occurs.

By monitoring a range of signal frequencies, however, Touché can derive much more information. Different body tissues have different capacitive properties, so monitoring a range of frequencies can detect a number of different paths that the electrical charge takes through the body.

Making sense of all of that SFCS information, however, requires analyzing hundreds of data points. As microprocessors have become steadily faster and less expensive, it now is feasible to use SFCS in touch interfaces, the researchers said.

"Devices keep getting smaller and increasingly are embedded throughout the environment, which has made it necessary for us to find ways to control or interact with them, and that is where Touché could really shine," Harrison said.

Sato said Touché could make computer interfaces as invisible to users as the embedded computers themselves. "This might enable us to one day do away with keyboards, mice and perhaps even conventional touchscreens for many applications," he said.

Among the proof-of-concept applications the researchers have investigated is a smart doorknob. Depending on whether the knob was grasped, touched with one finger or two, or pinched, a door could be programmed to lock or unlock itself, admit a guest, or even leave a reply message, such as "I'll be back in five minutes."

In another proof-of-concept experiment, they showed that SFCS could enhance a traditional touchscreen by sensing not just the fingertip, but the configuration of the rest of the hand. They created the equivalent of a mouse "right click," zoom in/out and copy/paste functions depending on whether the user pinched the phone's screen and back with one finger or two, or used a thumb.

The researchers also were able to monitor body gestures, such as touching fingers, grasping hands and covering ears by having subjects wear electrodes similar to wristwatches on both arms. Such gestures could be used to control a or other device.

They also showed that a single electrode attached to any water vessel could detect a number of gestures, such as fingertip submerged, hand submerged and hand on bottom. Sensing in liquids might be particularly suited to toys, games and food appliances.

Explore further: Bringing history and the future to life with augmented reality

Related Stories

Sharp Releases Notebook PC with Optical Sensor LCD Pad

Apr 21, 2009

Sharp Corporation will release into the Japanese market a new notebook PC employing an optical sensor LCD for the touchpad. Its new touch-sensing recognition method allows handwritten input and intuitive direct-touch ...

Fujitsu demonstrates new dual-touch resistive touch panel

May 11, 2011

Fujitsu will demonstrate its new, dual-touch (2 point), 4-wire analog resistive touch panel controller at Display Week 2011 in Los Angeles. The new technology promises to expand the capabilities of, and applications ...

Touch screen gamble: which technology to use

Oct 15, 2009

Prompted partly by the iPhone's phenomenal popularity, consumers are demanding and likely to get a wider range of touch screens on many more electronic devices.

Recommended for you

Patent talk: Google sharpens contact lens vision

Apr 16, 2014

(Phys.org) —A report from Patent Bolt brings us one step closer to what Google may have in mind in developing smart contact lenses. According to the discussion Google is interested in the concept of contact ...

Neuroscientist's idea wins new-toy award

Apr 15, 2014

When he was a child, Robijanto Soetedjo used to play with his electrically powered toys for a while and then, when he got bored, take them apart - much to the consternation of his parents.

Land Rover demos invisible bonnet / car hood (w/ video)

Apr 14, 2014

(Phys.org) —Land Rover has released a video demonstrating a part of its Discover Vision Concept—the invisible "bonnet" or as it's known in the U.S. the "hood" of the car. It's a concept the automaker ...

User comments : 0

More news stories

LinkedIn membership hits 300 million

The career-focused social network LinkedIn announced Friday it has 300 million members, with more than half the total outside the United States.

Researchers uncover likely creator of Bitcoin

The primary author of the celebrated Bitcoin paper, and therefore probable creator of Bitcoin, is most likely Nick Szabo, a blogger and former George Washington University law professor, according to students ...

Researchers successfully clone adult human stem cells

(Phys.org) —An international team of researchers, led by Robert Lanza, of Advanced Cell Technology, has announced that they have performed the first successful cloning of adult human skin cells into stem ...