A tactile glove provides subtle guidance to objects in the vicinity

October 10, 2012

Researchers at HIIT and Max Planck Institute for Informatics show how computer vision-based hand tracking and vibration feedback on the user's hand can be used to steer the user's hand toward an object of interest. A study shows an almost three-fold advantage in finding objects from complex visual scenes, such as library or supermarket shelves.

Finding an object from a complex real-world scene is a common yet time-consuming and frustrating chore. What makes this task complex is that humans' pattern recognition capability reduces to a serial one-by-one search when the items resemble each other.

Researchers from the Helsinki Institute for Information Technology HIIT and the Max Planck Institute for Informatics have developed a prototype of a glove that uses vibration feedback on the hand to guide the user's hand towards a predetermined target in 3D space. The glove could help users in daily tasks in supermarkets, parking lots, warehouses, libraries etc.

The main researcher, Ville Lehtinen of HIIT, explains "the advantage of steering a hand with tactile cues is that the user can easily interpret them in relation to the current field of view where the visual search is operating. This provides a very intuitive experience, like the hand being 'pulled' toward the target."

The solution builds on inexpensive off-the-shelf components such as four vibrotactile actuators on a simple glove and a Microsoft Kinect sensor for tracking the user's hand. The researchers published a dynamic guidance algorithm that calculates effective patterns based on distance and direction to the target.

In a , the complexity of the visual search task was increased by adding distractors to a scene. "In search tasks where there were hundreds of candidates but only one correct target, users wearing the glove were consistently faster, with up to three times faster performance than without the glove", says Dr. Antti Oulasvirta from Institute for Informatics.

Dr. Petteri Nurmi from HIIT adds: "This level of improvement in search performance justifies several practical applications. For instance, warehouse workers could have gloves that guide them to target shelfs, or a pedestrian could navigate using this glove. With the relatively inexpensive components and the dynamic guidance algorithm, others can easily build their own personal guidance systems."

Explore further: Google seeing-hand patent shows smart glove ambitions

More information: The research paper will be presented at the 25th ACM Symposium on User Interface Software and Technology UIST'12 in Boston, MA, USA on 7 October, 2012.

Related Stories

Glove designers plan messaging path for deaf-blind

April 7, 2012

(Phys.org) -- People coping with the double absence of vision and hearing can communicate via mobile devices with the help of a special glove, now under development in Germany’s Design Research Lab. The Mobile Lorm Glove ...

A glove on your hand can change your mind

March 10, 2011

(PhysOrg.com) -- Unconsciously, right-handers associate good with the right side of space and bad with the left. But this association can be rapidly changed, according to a study published online March 9, 2011 in Psychological ...

Complete feel of user interfaces with vibrotactile feedback

October 4, 2012

Touchscreen mobile devices, phones and tablet computers, have gained prominence in our everyday life in the past years. Their user interfaces, however, make quite crude use of touch and the somatosensory system. Teemu Ahmaniemi ...

Recommended for you

Microsoft aims at Apple with high-end PCs, 3D software

October 26, 2016

Microsoft launched a new consumer offensive Wednesday, unveiling a high-end computer that challenges the Apple iMac along with an updated Windows operating system that showcases three-dimensional content and "mixed reality."

Making it easier to collaborate on code

October 26, 2016

Git is an open-source system with a polarizing reputation among programmers. It's a powerful tool to help developers track changes to code, but many view it as prohibitively difficult to use.

Dutch unveil giant vacuum to clean outside air

October 25, 2016

Dutch inventors Tuesday unveiled what they called the world's first giant outside air vacuum cleaner—a large purifying system intended to filter out toxic tiny particles from the atmosphere surrounding the machine.


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.