Feeling the way: Robotic device can help visually impaired people

November 23, 2009 by Anne Trafton
Graphic: Christine Daniloff

(PhysOrg.com) -- For many people, it has become routine to go online to check out a map before traveling to a new place. But for blind people, Google maps and other visual mapping applications are of little use. Now, a unique device developed at MIT could give the visually impaired the same kind of benefit that sighted people get from online maps.

The BlindAid system, developed in MIT’s Touch Lab, allows blind people to “feel” their way around a virtual model of a room or building, familiarizing themselves with it before going there.

Mandayam Srinivasan, director of the Touch Lab and affiliated with the Research Laboratory of Electronics and the Department of Mechanical Engineering, is working with the Carroll Center for the Blind in Newton, Mass., to develop and test the device. Preliminary results show that when blind people have the chance to preview a virtual model of a room, they have an easier time navigating their way around the actual room later on.

That advantage could be invaluable for the visually impaired, says Joseph Kolb, a mobility instructor at the Carroll Center. He notes that one of the toughest challenges a visually impaired person faces is entering an unfamiliar environment with no human or dog to offer guidance.

“You don’t know where you are, you don’t know what’s around you, and there may or may not be people around to help you,” he says.

A cane for virtual navigation

The BlindAid system builds on a device called the Phantom, developed at MIT in the early 1990s and commercialized by SensAble Technologies. Phantom consists of a that the user grasps as if holding a stylus. The stylus can create the sensation of touch by exerting a small, precisely controlled force on the fingers of the user.

The BlindAid stylus functions much like a blind person’s cane, allowing the user to feel virtual floors, walls, doors and other objects. The stylus is connected to a computer programmed with a three-dimensional map of the room. Whenever a virtual obstacle is encountered, the computer directs the stylus to produce a force against the user’s hand, mimicking the reaction force from a real obstacle.

Srinivasan’s team has tested the device in about 10 visually impaired subjects at the Carroll Center, a non-profit agency that offers education, training and rehabilitation programs to about 2,000 visually impaired people per year.

To successfully use such a system, the visually impaired person must have a well-developed sense of space, says Kolb. For those people, “this offers the prospect of being able to preview an environment and have a sense of what’s in the environment, the shape of it, and where landmarks are located,” he says.

During the testing, Kolb realized that BlindAid could also help mobility instructors evaluate the exploration strategies the subject is using — whether he or she has an organized approach or tends to get stuck in a certain area.

Orly Lahav, a former postdoctoral associate in the Touch Lab, and David Schloerb, a research scientist in MIT’s Research Laboratory of Electronics, did much of the work to develop BlindAid. Lahav presented the work at the Virtual Rehabilitation 2009 International Conference in Israel this summer.

Once Srinivasan obtains additional funding, he hopes to incorporate the BlindAid system into the Carroll Center’s training program, which will yield user feedback that should help him refine the system for commercial production. In the long term, he believes BlindAid could be used to help blind people not only preview public spaces such as train stations, but also plan and travel by public transportation using virtual route maps that they can download and interact with through touch.

In October, Srinivasan presented the system at an event at New York’s Metropolitan Museum of Art, called “Art Beyond Sight,” sponsored by an organization of the same name, which promotes ways to help experience visual arts. In museums, visually impaired people can experience art through verbal descriptions and touch, and devices such as BlindAid could allow them to find out how to navigate the museum before visiting.

“There is a big difference between going to a totally unknown place and a place for which you have a mental map,” says Srinivasan.

Provided by Massachusetts Institute of Technology (news : web)

Explore further: Assistive technologies for the blind

Related Stories

Assistive technologies for the blind

December 15, 2004

Researchers at the University of California, Santa Cruz, are developing new assistive technologies for the blind based on advances in computer vision that have emerged from research in robotics. A "virtual white cane" is ...

Leveling the gaming field

May 13, 2008

A new computer game developed by MIT and Singaporean students makes it possible for visually impaired people to play the game on a level field with their sighted friends.

New Bluetooth system orients blind and sighted pedestrians

September 18, 2008

(PhysOrg.com) -- A new Bluetooth system designed primarily for blind people places a layer of information technology over the real world to tell pedestrians about points of interest along their path as they pass them.

Enabling the blind to find their way

October 24, 2008

(PhysOrg.com) -- “Eyes on the future” is the mantra of the ‘World Sight Day’ held this month to raise awareness of blindness and vision impairment. New technologies, developed by European researchers offering the ...

Virtual maps for the blind

September 10, 2009

The blind and visually impaired often rely on others to provide cues and information on navigating through their environments. The problem with this method is that it doesn't give them the tools to venture out on their own, ...

Recommended for you

Inferring urban travel patterns from cellphone data

August 29, 2016

In making decisions about infrastructure development and resource allocation, city planners rely on models of how people move through their cities, on foot, in cars, and on public transportation. Those models are largely ...

How machine learning can help with voice disorders

August 29, 2016

There's no human instinct more basic than speech, and yet, for many people, talking can be taxing. 1 in 14 working-age Americans suffer from voice disorders that are often associated with abnormal vocal behaviors - some of ...

Auto, aerospace industries warm to 3D printing

August 25, 2016

New 3D printing technology unveiled this week sharply increases the size of objects that can be produced, offering new possibilities to remake manufacturing in the auto, aerospace and other major industries.


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.