Qeexo screentouch experience puts knuckles and nails to work (w/ video)

Nov 17, 2012 by Nancy Owano report

(Phys.org)—Touchscreen computing as an "experience" has only just begun. Working on ideas they seeded at Carnegie Mellon, computer-human interaction researchers have started a San Jose, California, company Qeexo, that features technology called FingerSense. With FingerSense, the computer user can perform tasks with more than just the finger's tips, expanding the use of the finger over to using knuckles and nails. Each part of the finger can order up different tasks, such as managing e-mail content, managing objects in computer games and rubbing-in features when sketching a face. They have managed to expand the concept of fingerpad as the sole interface that can be used on the touchscreen.

They are showing the world expanded finger options. Tomorrow's may think nothing, for example, of knocking twice with a knuckle to bring up a new page.

The company website is thin on technical details; little is said how it is done under the hood, but their video offers an impressive appreciation of what is done. When , for example, the user knocks coconuts with knuckles, squashes berries with fingerpads, and slices bananas with nails. But how does Qeexo's technology enable the computer to differentiate between fingertip, nail, or knuckle on a ? Their FingerSense technology involves an acoustic sensor that is small enough to fit inside a and can capture made by various touches. This can pick up on different "sounds."

Chris Harrison, Julia Schwarz, and Scott Hudson, authors at Carnegie Mellon of a paper on finger interaction on Touch Surfaces, noted back in 2011 how "humans use different parts of their fingers in different ways – to scratch an itch, type on a keyboard, tap a co-worker on the shoulder, or knock on a door." They thought about this and how, with careful design, these norms could be leveraged "such that existing finger behaviors could be ported to and made relevant in digital domains."

At a time when direct-touch interfaces are around in everyday life, from mall store kiosks, to tablets and smartphones, it is not difficult to understand that Qeexo is upbeat about its future. Qeexo was spun off from Carnegie Mellon University this year and there is both an office in San Jose and also a R&D team in Pittsburgh. According to reports, they are talking to phone manufacturers, and they hope to see FingerSense in smartphones within a year.

Explore further: Patent talk: Google sharpens contact lens vision

More information: chrisharrison.net/projects/tapsense/tapsense.pdf
www.qeexo.com/

Related Stories

Microsoft puts finger on 1ms touchscreen (w/ video)

Mar 13, 2012

(PhysOrg.com) -- Touchscreen features in smartphones and tablets are satisfying perks in going wireless and mouse-less in mobile computing, but now Microsoft wants to make people aware of how much more satisfying ...

Recommended for you

Patent talk: Google sharpens contact lens vision

Apr 16, 2014

(Phys.org) —A report from Patent Bolt brings us one step closer to what Google may have in mind in developing smart contact lenses. According to the discussion Google is interested in the concept of contact ...

Neuroscientist's idea wins new-toy award

Apr 15, 2014

When he was a child, Robijanto Soetedjo used to play with his electrically powered toys for a while and then, when he got bored, take them apart - much to the consternation of his parents.

Land Rover demos invisible bonnet / car hood (w/ video)

Apr 14, 2014

(Phys.org) —Land Rover has released a video demonstrating a part of its Discover Vision Concept—the invisible "bonnet" or as it's known in the U.S. the "hood" of the car. It's a concept the automaker ...

User comments : 6

Adjust slider to filter visible comments by rank

Display comments: newest first

NeutronicallyRepulsive
1 / 5 (1) Nov 17, 2012
I love how they always include drawing capability. Nobody actually does that (more than maybe once). Otherwise why not, but no big deal.
DonaldJLucas
2.3 / 5 (4) Nov 18, 2012
This is probably the next big thing, but I do wonder what happens on the day that you cut your nails? Also, I wonder if they have made adequate consideration that old people like to buy things too, but usually have arthritic knuckles!
Skepticus
3.5 / 5 (6) Nov 18, 2012
If all commands fail, direct all five knuckles at the screen at high speed.
powerup1
not rated yet Dec 02, 2012
If all commands fail, direct all five knuckles at the screen at high speed.


Unless you have some really unusual hands, you contact with only 4 of your knuckles when you punch. ;-)
powerup1
1 / 5 (1) Dec 02, 2012
If all commands fail, direct all five knuckles at the screen at high speed.


Unless you have some really unusual hands, you contact with only 4 of your knuckles when you punch. The knuckle of the thumb being perpendicular to the other knuckles of the hand when you form a fist. ;-)
DonaldJLucas
not rated yet Dec 03, 2012
Thanks for bringing a smile to my face today ;-)

More news stories

Hackathon team's GoogolPlex gives Siri extra powers

(Phys.org) —Four freshmen at the University of Pennsylvania have taken Apple's personal assistant Siri to behave as a graduate-level executive assistant which, when asked, is capable of adjusting the temperature ...

Better thermal-imaging lens from waste sulfur

Sulfur left over from refining fossil fuels can be transformed into cheap, lightweight, plastic lenses for infrared devices, including night-vision goggles, a University of Arizona-led international team ...

Deadly human pathogen Cryptococcus fully sequenced

Within each strand of DNA lies the blueprint for building an organism, along with the keys to its evolution and survival. These genetic instructions can give valuable insight into why pathogens like Cryptococcus ne ...