Google seeing-hand patent shows smart glove ambitions

Aug 25, 2012 by Nancy Owano weblog

(Phys.org)—Google has been granted a patent for devices and methods for getting information with one's hands. Their patent is titled "Seeing with your Hand."

Google watchers say this is a harbinger of Google's plans to come up with the mother of all smart , a missing part of the Project Glass puzzle that just could be the full solution to wearable computing. While Glass has strong potential for augmented reality input through the eyes, Google is turning to hand in glove to interact with the virtual world. The recent glove-based spells out possibilities of getting and conveying information through hand control.

The patent was applied in July 29 of last year and this month was published. Among the inventors listed on the patent is one Sergey Brin.

"Humans naturally use their hands and fingers as a means of gathering information. For example, when moving in a dark environment, humans naturally put their hands out to gather information about their surroundings by touch. Similarly, when a small object is lost, for example, underneath a couch, humans naturally put their hands under the couch to locate the lost object by touch," says the .

"In addition to gathering information, humans also naturally use their hands and fingers to convey information. For example, when giving someone directions to a location, many humans naturally use one or more fingers to point towards the location. Similarly, when discussing a particular object, many humans naturally use one or more fingers to point to the object. However, typically the amount and types of information that can be conveyed by a human's hands is limited to specific contexts."

That inspired the inventors at Google to look for devices and methods for gathering and conveying information with a hand.

In order to "see" an inaccessible environment, says the patent, a user may wear a device equipped with one or more detectors on one of his or her hands, or on other areas of the user's body.

The smart glove suggested by the inventors carries out specific services which they describe. The glove's cameras can act as magnifiers. The motion detectors, gyroscopes, and accelerometers can support navigation type applications similar to those on smartphones,. Wireless communication technology could facilitate data transfer between the smart glove users, or enable users to take part in mobile commerce.

Services like these will be carried out by a smart glove crammed with electronics—cameras on the fingertips, motion detectors on the fingers, a CPU, RAM and storage and wireless communication chips on the back.

Outside , technological explorations for deploying information using the hand are nothing new as evidenced in previous research. Studies dating back to the 1990s have examined the notion of glove-based input

One such piece of research is by Vitor F. Pamplona and colleagues who wrote a paper called "The Image-Based Data Glove," Proceedings of X Symposium on Virtual and Augmented Reality, in 2008. "Data gloves are devices equipped with sensors that capture the movements of the hand of the user in order to select or manipulate objects in a ." Though data gloves were introduced three decades ago, said the authors, "good data gloves are too expensive and only a few of them can perceive the full set of hand movements."

The authors proposed a device that uses a camera to track visual markers at finger tips, and a software module to compute the position of each finger tip and its joints in real-time. They also talked about turning their prototype into a low-cost interaction device.

Explore further: The ethics of driverless cars

More information: patft.uspto.gov

Related Stories

Google patent sends ring signals to Project Glass

May 19, 2012

(Phys.org) -- Google's September 2011 patent that was filed for a wearable display device was granted this week, which suggests that its envisioned heads-up display device can be controlled by infrared markers ...

Google patent calls on eyes to unlock smart glasses

Aug 09, 2012

(Phys.org) -- In patent language, the application granted to Google this week says simply “Unlocking a screen using eye tracking information” but the message seems clear enough that Google plans ...

Glove-friendly touchscreen goes on exhibit

Oct 26, 2011

(PhysOrg.com) -- A new screen has been designed that can work with gloved hands, and it comes from Japan-based SMK. The target application will be car-navigation systems which drivers can operate while wearing ...

Recommended for you

Hitchhiking robot reaches journey's end in Canada

3 hours ago

A chatty robot with an LED-lit smiley face sent hitchhiking across Canada this summer as part of a social experiment reached its final destination Thursday after several thousand kilometers on the road.

Microsoft to unveil new Windows software

3 hours ago

A news report out Thursday indicated that Microsoft is poised to give the world a glimpse at a new-generation computer operating system that will succeed Windows 8.

Music site SoundCloud to start paying artists

5 hours ago

SoundCloud said Thursday that it will start paying artists and record companies whose music is played on the popular streaming site, a move that will bring it in line with competitors such as YouTube and Spotify.

The ethics of driverless cars

6 hours ago

Jason Millar, a PhD Candidate in the Department of Philosophy, spends a lot of time thinking about driverless cars. Though you aren't likely to be able to buy them for 10 years, he says there are a number ...

User comments : 2

Adjust slider to filter visible comments by rank

Display comments: newest first

ODesign
not rated yet Aug 26, 2012
Probably cheeper and more wearable to make a camera bracelet.
.
You can calculate the finger tip positions using the visible muscle movements in the back of the hand even if the finger tip is visually blocked by the palm. It's sort of like how you could use a camera to read lips and then reverse calculate the unseen tension of vocal cords and throat/mouth cavity shape.
.
You don't even need a very high resolution camera if you distort the visual field optically (mirrors) to give more pixels to the key areas. You do need some pretty fast large matrix transformations of the pixel data to compensate for skew and positioning. Plus after de-skew you need a rather large number of matrix transformations to convert the normalized visual matrix into a 3d model of a hands position. A hand has about 19 degrees of freedom, so 19 parallel matrix transforms plus a good semi-automatic matrix transform generating algorithm (try IEEE archives).
TemporalCipher
not rated yet Sep 25, 2012
I would think the two most useful attributes of "intelligent gloves" would transmit the same tactile sensations our hand feels when it touch's an object, but still being protective. Put your hand in your pocket and you know how a dollar bill, or piece of paper "feels" The next step would be chemical analysis of what you touch.