Google seeing-hand patent shows smart glove ambitions

Aug 25, 2012 by Nancy Owano weblog

(Phys.org)—Google has been granted a patent for devices and methods for getting information with one's hands. Their patent is titled "Seeing with your Hand."

Google watchers say this is a harbinger of Google's plans to come up with the mother of all smart , a missing part of the Project Glass puzzle that just could be the full solution to wearable computing. While Glass has strong potential for augmented reality input through the eyes, Google is turning to hand in glove to interact with the virtual world. The recent glove-based spells out possibilities of getting and conveying information through hand control.

The patent was applied in July 29 of last year and this month was published. Among the inventors listed on the patent is one Sergey Brin.

"Humans naturally use their hands and fingers as a means of gathering information. For example, when moving in a dark environment, humans naturally put their hands out to gather information about their surroundings by touch. Similarly, when a small object is lost, for example, underneath a couch, humans naturally put their hands under the couch to locate the lost object by touch," says the .

"In addition to gathering information, humans also naturally use their hands and fingers to convey information. For example, when giving someone directions to a location, many humans naturally use one or more fingers to point towards the location. Similarly, when discussing a particular object, many humans naturally use one or more fingers to point to the object. However, typically the amount and types of information that can be conveyed by a human's hands is limited to specific contexts."

That inspired the inventors at Google to look for devices and methods for gathering and conveying information with a hand.

In order to "see" an inaccessible environment, says the patent, a user may wear a device equipped with one or more detectors on one of his or her hands, or on other areas of the user's body.

The smart glove suggested by the inventors carries out specific services which they describe. The glove's cameras can act as magnifiers. The motion detectors, gyroscopes, and accelerometers can support navigation type applications similar to those on smartphones,. Wireless communication technology could facilitate data transfer between the smart glove users, or enable users to take part in mobile commerce.

Services like these will be carried out by a smart glove crammed with electronics—cameras on the fingertips, motion detectors on the fingers, a CPU, RAM and storage and wireless communication chips on the back.

Outside , technological explorations for deploying information using the hand are nothing new as evidenced in previous research. Studies dating back to the 1990s have examined the notion of glove-based input

One such piece of research is by Vitor F. Pamplona and colleagues who wrote a paper called "The Image-Based Data Glove," Proceedings of X Symposium on Virtual and Augmented Reality, in 2008. "Data gloves are devices equipped with sensors that capture the movements of the hand of the user in order to select or manipulate objects in a ." Though data gloves were introduced three decades ago, said the authors, "good data gloves are too expensive and only a few of them can perceive the full set of hand movements."

The authors proposed a device that uses a camera to track visual markers at finger tips, and a software module to compute the position of each finger tip and its joints in real-time. They also talked about turning their prototype into a low-cost interaction device.

Explore further: Touch-responsive 3-D maps provide independence to the visually impaired

More information: patft.uspto.gov

Related Stories

Google patent sends ring signals to Project Glass

May 19, 2012

(Phys.org) -- Google's September 2011 patent that was filed for a wearable display device was granted this week, which suggests that its envisioned heads-up display device can be controlled by infrared markers ...

Google patent calls on eyes to unlock smart glasses

Aug 09, 2012

(Phys.org) -- In patent language, the application granted to Google this week says simply “Unlocking a screen using eye tracking information” but the message seems clear enough that Google plans ...

Glove-friendly touchscreen goes on exhibit

Oct 26, 2011

(PhysOrg.com) -- A new screen has been designed that can work with gloved hands, and it comes from Japan-based SMK. The target application will be car-navigation systems which drivers can operate while wearing ...

Recommended for you

Self-driving cars could be the answer to congested roads

4 hours ago

If cars with drivers still suffer under gridlock conditions on roads, how will driverless cars fare any better? With greater computerisation and network awareness, driverless cars may be the answer to growing ...

Gecko inspired pads allow researchers to climb glass wall

Nov 19, 2014

A team of researchers working at Stanford University has used prior research involving the means by which gecko's climb walls to create pads that allow a human to do very nearly the same thing. In their paper ...

User comments : 2

Adjust slider to filter visible comments by rank

Display comments: newest first

ODesign
not rated yet Aug 26, 2012
Probably cheeper and more wearable to make a camera bracelet.
.
You can calculate the finger tip positions using the visible muscle movements in the back of the hand even if the finger tip is visually blocked by the palm. It's sort of like how you could use a camera to read lips and then reverse calculate the unseen tension of vocal cords and throat/mouth cavity shape.
.
You don't even need a very high resolution camera if you distort the visual field optically (mirrors) to give more pixels to the key areas. You do need some pretty fast large matrix transformations of the pixel data to compensate for skew and positioning. Plus after de-skew you need a rather large number of matrix transformations to convert the normalized visual matrix into a 3d model of a hands position. A hand has about 19 degrees of freedom, so 19 parallel matrix transforms plus a good semi-automatic matrix transform generating algorithm (try IEEE archives).
TemporalCipher
not rated yet Sep 25, 2012
I would think the two most useful attributes of "intelligent gloves" would transmit the same tactile sensations our hand feels when it touch's an object, but still being protective. Put your hand in your pocket and you know how a dollar bill, or piece of paper "feels" The next step would be chemical analysis of what you touch.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.