TapSense touchscreen technology distinguishes taps by parts of finger (w/ video)

October 19, 2011

TapSense touchscreen technology distinguishes taps by parts of finger (w/ video)

Enlarge

Smartphone and tablet computer owners have become adept at using finger taps, flicks and drags to control their touchscreens. But Carnegie Mellon University researchers have found that this interaction can be enhanced by taking greater advantage of the finger's anatomy and dexterity.

By attaching a microphone to a , the CMU scientists showed they can tell the difference between the tap of a , the pad of the finger, a fingernail and a knuckle. This technology, called TapSense, enables richer touchscreen interactions. While typing on a , for instance, users might capitalize letters simply by tapping with a fingernail instead of a finger tip, or might switch to numerals by using the pad of a finger, rather toggling to a different set of keys.

Another possible use would be a painting app that uses a variety of tapping modes and finger motions to control a pallet of colors, or switch between drawing and erasing without having to press buttons.

This video is not supported by your browser at this time.

"TapSense basically doubles the input bandwidth for a touchscreen," said Chris Harrison, a Ph.D. student in Carnegie Mellon's Institute (HCII). "This is particularly important for smaller touchscreens, where screen real estate is limited. If we can remove mode buttons from the screen, we can make room for more content or can make the remaining buttons larger."

TapSense touchscreen technology distinguishes taps by parts of finger (w/ video)
TapSense was developed by Harrison, fellow Ph.D. student Julia Schwarz, and Scott Hudson, a professor in the HCII. Harrison will discuss the technology today (Oct. 19) at the Association for Computing Machinery's Symposium on and Technology in Santa Barbara, Calif.

"TapSense can tell the difference between different parts of the finger by classifying the sounds they make when they strike the touchscreen," Schwarz said. An inexpensive microphone could be readily attached to a touchscreen for this purpose. The microphones already in devices for phone conversations would not work well for the application, however, because they are designed to capture voices, not the sort of noise that TapSense needs to operate.

TapSense touchscreen technology distinguishes taps by parts of finger (w/ video)
The technology also can use sound to discriminate between passive tools (i.e., no batteries) made from such materials as wood, acrylic and polystyrene foam. This would enable people using styluses made from different materials to collaboratively sketch or take notes on the same surface, with each person's contributions appearing in a different color or otherwise noted.

The researchers found that their proof-of-concept system was able to distinguish between the four types of finger inputs with 95 percent accuracy, and could distinguish between a pen and a finger with 99 percent accuracy.

More information: http://chrisharris … rch/TapSense

Provided by Carnegie Mellon University search and more info website

Filter


Move the slider to adjust rank threshold, so that you can hide some of the comments.


Display comments: newest first

that_guy
Oct 19, 2011

Rank: 1 / 5 (1)
That's great and all, but the last time I had a smartphone with a resistive touchscreen was like 5 years ago.

Why am I bashing this? Have you ever tried to use your fingernail on a modern capacitive touch screen? Doesn't work, does it?

That leaves us with the finger pad, knuckle (which won't work with low quality capacitive screens), and finger tip touch. I don't know about you but I don't take care to rap my fingers a certain way. And how I touch a screen is very determinate on how I'm holding it. Consider using this this with one hand - I see dropped phones.

While I personally prefer the older resistive screens, I don't see them coming back any time soon because they use more energy.

Which brings us to the second point - using an always on microphone and accompanying processing power. My concern is energy usage, but I'm sure the libertarians will have other concerns as well.

/end rant.
Neophile
Oct 19, 2011

Rank: 1 / 5 (1)
Just tried using my fingernail on a modern capacitive touch screen. It worked fine for me.
that_guy
Oct 19, 2011

Rank: 3 / 5 (2)
Just tried using my fingernail on a modern capacitive touch screen. It worked fine for me.

If you have a very good capacitive screen and your nails are trim, it can work as long as your skin gets close enough to it. if you have long nails, like many women do, it won't work at all.

even so, if you try tapping it with only your finger nail all day, you will find it too inconsistent to use on a regular basis.

Pass it to your GF or wife, and she will likely have a much more difficult time than you.
Rank 5 /5 (1 vote)
Relevant PhysicsForums posts

More news stories

Browser wars flare in mobile space

The browser wars are heating up again, but this time the fight is for dominance of the mobile Internet.

Technology / Software

created 9 hours ago | popularity 5 / 5 (1) | comments 3

Probability of contamination from severe nuclear reactor accidents is higher than expected: study

Catastrophic nuclear accidents such as the core meltdowns in Chernobyl and Fukushima are more likely to happen than previously assumed. Based on the operating hours of all civil nuclear reactors and the number ...

Technology / Energy & Green Tech

created May 22, 2012 | popularity 3.6 / 5 (22) | comments 56 | with audio podcast

SpotterRF debuts Radar Backpack Kit (w/ Video)

(Phys.org) -- SpotterRF has announced a special radar backpack kit designed to enhance situational awareness for soldiers on the ground. The company says its special radar is designed for warfighters as part ...

Technology / Hi Tech & Innovation

created May 26, 2012 | popularity 5 / 5 (5) | comments 13 | with audio podcast report

HyperSolar shows dirty water no barrier to power world

(Phys.org) -- The Santa Barbara, California, company, HyperSolar, is set to transparently share the ups and downs of its research experiences toward the company’s ultimate vision, successfully producing ...

Technology / Energy & Green Tech

created May 24, 2012 | popularity 4.8 / 5 (16) | comments 17 | with audio podcast report

Tesla to launch electric sedan in US on June 22

Tesla Motors said Tuesday it would begin deliveries of "the world's first premium electric sedan" on June 22, slightly ahead of schedule.

Technology / Energy & Green Tech

created May 22, 2012 | popularity 4.5 / 5 (12) | comments 18


'Unzipped' carbon nanotubes could help energize fuel cells, batteries

Multi-walled carbon nanotubes riddled with defects and impurities on the outside could replace some of the expensive platinum catalysts used in fuel cells and metal-air batteries, according to scientists at ...

T cells 'hunt' parasites like animal predators seek prey, study shows

By pairing an intimate knowledge of immune-system function with a deep understanding of statistical physics, a cross-disciplinary team at the University of Pennsylvania has arrived at a surprising finding: T cells use a movement ...

Computer model used to pinpoint prime materials for efficient carbon capture

When power plants begin capturing their carbon emissions to reduce greenhouse gases – and to most in the electric power industry, it's a question of when, not if – it will be an expensive undertaking.

Change in developmental timing was crucial in the evolutionary shift from dinosaurs to birds: study

At first glance, it's hard to see how a common house sparrow and a Tyrannosaurus Rex might have anything in common. After all, one is a bird that weighs less than an ounce, and the other is a dinosaur that ...

Yale study concludes public apathy over climate change unrelated to science literacy

Are members of the public divided about climate change because they don't understand the science behind it? If Americans knew more basic science and were more proficient in technical reasoning, would public consensus match ...

Same gene that stunts infants' growth also makes them grow too big: research

UCLA geneticists have identified the mutation responsible for IMAGe* syndrome, a rare disorder that stunts infants' growth. The twist? The mutation occurs on the same gene that causes Beckwith-Wiedemann syndrome, which makes ...