A tactile glove provides subtle guidance to objects in the vicinity

Oct 10, 2012

Researchers at HIIT and Max Planck Institute for Informatics show how computer vision-based hand tracking and vibration feedback on the user's hand can be used to steer the user's hand toward an object of interest. A study shows an almost three-fold advantage in finding objects from complex visual scenes, such as library or supermarket shelves.

Finding an object from a complex real-world scene is a common yet time-consuming and frustrating chore. What makes this task complex is that humans' pattern recognition capability reduces to a serial one-by-one search when the items resemble each other.

Researchers from the Helsinki Institute for Information Technology HIIT and the Max Planck Institute for Informatics have developed a prototype of a glove that uses vibration feedback on the hand to guide the user's hand towards a predetermined target in 3D space. The glove could help users in daily tasks in supermarkets, parking lots, warehouses, libraries etc.

The main researcher, Ville Lehtinen of HIIT, explains "the advantage of steering a hand with tactile cues is that the user can easily interpret them in relation to the current field of view where the visual search is operating. This provides a very intuitive experience, like the hand being 'pulled' toward the target."

The solution builds on inexpensive off-the-shelf components such as four vibrotactile actuators on a simple glove and a Microsoft Kinect sensor for tracking the user's hand. The researchers published a dynamic guidance algorithm that calculates effective patterns based on distance and direction to the target.

In a , the complexity of the visual search task was increased by adding distractors to a scene. "In search tasks where there were hundreds of candidates but only one correct target, users wearing the glove were consistently faster, with up to three times faster performance than without the glove", says Dr. Antti Oulasvirta from Institute for Informatics.

Dr. Petteri Nurmi from HIIT adds: "This level of improvement in search performance justifies several practical applications. For instance, warehouse workers could have gloves that guide them to target shelfs, or a pedestrian could navigate using this glove. With the relatively inexpensive components and the dynamic guidance algorithm, others can easily build their own personal guidance systems."

Explore further: Increasing ecological understanding with virtual worlds and augmented reality

More information: The research paper will be presented at the 25th ACM Symposium on User Interface Software and Technology UIST'12 in Boston, MA, USA on 7 October, 2012.

Related Stories

Glove designers plan messaging path for deaf-blind

Apr 07, 2012

(Phys.org) -- People coping with the double absence of vision and hearing can communicate via mobile devices with the help of a special glove, now under development in Germany’s Design Research Lab. The ...

A glove on your hand can change your mind

Mar 10, 2011

(PhysOrg.com) -- Unconsciously, right-handers associate good with the right side of space and bad with the left. But this association can be rapidly changed, according to a study published online March 9, ...

Complete feel of user interfaces with vibrotactile feedback

Oct 04, 2012

Touchscreen mobile devices, phones and tablet computers, have gained prominence in our everyday life in the past years. Their user interfaces, however, make quite crude use of touch and the somatosensory system. Teemu Ahmaniemi ...

Recommended for you

Startup marries digital, physical worlds

11 hours ago

A startup business that wants to link the realm of physical objects to the digital world of the Internet is basing its future on low-cost, highly engineered, one-of-a-kind plastic stamps.

Ears, grips and fists take on mobile phone user ID

Apr 26, 2015

A research project has been under way to explore a biometric authentication system dubbed Bodyprint, with interesting test results. Bodyprint has been designed to detect users' biometric features using the ...

Zensors: Making sense with live question feeds

Apr 23, 2015

Getting answers to what you really want to ask, beyond if the door is open or shut, could be rather easy. A video on YouTube demonstrates something called Zensors. Started at Carnegie Mellon last year and ...

User comments : 0

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.