MIT finger device reads to the blind in real time

Jul 08, 2014 by Rodrique Ngowi
In this Thursday, June 26, 2014 photo, a model wears a FingerReader ring at the Massachusetts Institute of Technology's Media Lab in Cambridge, Mass. Researchers designed and developed the instrument, which enables people with visual disabilities to read text printed on paper or electronic devices. (AP Photo Stephan Savoia)

Scientists at the Massachusetts Institute of Technology are developing an audio reading device to be worn on the index finger of people whose vision is impaired, giving them affordable and immediate access to printed words.

The so-called FingerReader, a prototype produced by a 3-D printer, fits like a ring on the user's finger, equipped with a small camera that scans text. A synthesized voice reads words aloud, quickly translating books, restaurant menus and other needed materials for daily living, especially away from home or office.

Reading is as easy as pointing the finger at text. Special software tracks the finger movement, identifies words and processes the information. The device has vibration motors that alert readers when they stray from the script, said Roy Shilkrot, who is developing the device at the MIT Media Lab.

For Jerry Berrier, 62, who was born blind, the promise of the FingerReader is its portability and offer of real-time functionality at school, a doctor's office and restaurants.

"When I go to the doctor's office, there may be forms that I wanna read before I sign them," Berrier said.

He said there are other devices on the market for those with vision impairments, but none that he knows of that will read in real time.

Berrier manages training and evaluation for a federal program that distributes technology to low-income people in Massachusetts and Rhode Island who have lost their sight and hearing. He works from the Perkins School for the Blind in Watertown, Massachusetts.

In this Thursday, June 26, 2014 photo, a FingerReader ring lies on a book's page at the Massachusetts Institute of Technology's Media Lab in Cambridge, Mass. Researchers designed and developed the instrument, which enables people with visual disabilities to read text printed on paper or electronic devices. (AP Photo Stephan Savoia)

"Everywhere we go, for folks who are sighted, there are things that inform us about the products that we are about to interact with. I wanna be able to interact with those same products, regardless of how I have to do it," Berrier said.

Pattie Maes, an MIT professor who founded and leads the Fluid Interfaces research group developing the prototype, says the FingerReader is like "reading with the tip of your finger and it's a lot more flexible, a lot more immediate than any solution that they have right now."

Developing the gadget has taken three years of software coding, experimenting with various designs and working on feedback from a test group of . Much work remains before it is ready for the market, Shilkrot said, including making it work on cellphones.

Shilkrot said developers believe they will be able to affordably market the FingerReader but he could not yet estimate a price. The potential market includes some of the 11.2 million people in the United States with , according to U.S. Census Bureau estimates.

Current technology used in homes and offices offers cumbersome scanners that must process the desired script before it can be read aloud by character-recognition software installed on a computer or smartphone, Shilkrot said. The FingerReader would not replace Braille—the system of raised dots that form words, interpreted by touch. Instead, Shilkrot said, the new device would enable users to access a vast number of books and other materials that are not currently available in Braille.

In this June 26, 2014 photo, a model wears a FingerReader ring at the Massachusetts Institute of Technology's Media Lab in Cambridge, Mass. Researchers designed and developed the instrument, which enables people with visual disabilities to read text printed on paper or electronic devices. (AP Photo Stephan Savoia)

Developers had to overcome unusual challenges to help people with visual impairments move their reading fingers along a straight line of printed text that they could not see. Users also had to be alerted at the beginning and end of the reading material.

Their solutions? Audio cues in the software that processes information from the FingerReader and vibration motors in the ring.

The FingerReader can read papers, books, magazines, newspapers, computer screens and other devices, but it has problems with text on a touch screen, said Shilkrot.

In this June 26, 2014 photo, a model wears a FingerReader ring at the Massachusetts Institute of Technology's Media Lab in Cambridge, Mass. Researchers designed and developed the instrument, which enables people with visual disabilities to read text printed on paper or electronic devices. (AP Photo Stephan Savoia)

That's because touching the screen with the tip of the finger would move text around, producing unintended results. Disabling the touch-screen function eliminates the problem, he said.

Berrier said affordable pricing could make the FingerReader a key tool to help people with vision impairment integrate into the modern information economy.

"Any tool that we can get that gives us better access to printed material helps us to live fuller, richer, more productive lives, Berrier said.

Explore further: Good vibrations bring braille into the 21st century

4.6 /5 (19 votes)
add to favorites email to friend print save as pdf

Related Stories

Good vibrations bring braille into the 21st century

May 30, 2014

Even in a world of digital devices, braille continues to be a vital part of life for blind people. For nearly 200 years, this versatile writing system has allowed them to learn, work and live in a more independent ...

Samsung has assistive tech trio for Galaxy Core Advance

Mar 15, 2014

(Phys.org) —Samsung Electronics introduced a trio of accessories on Friday that are designed to help users who are disabled and visually impaired—those with partial or greater loss of vision. Their smartphones ...

Snail Braille reader could read books to the blind

May 06, 2011

(PhysOrg.com) -- To most of us, Braille is largely a mystery. It feels really cool, but the idea of actually reading it is kind of a pipe dream. Our sense of touch simply is not as sensitive as that of a blind ...

Recommended for you

Medical advances turn science fiction into science fact

Jul 18, 2014

Exoskeletons helping the paralysed to walk, tiny maggot-inspired devices gnawing at brain tumours, machines working tirelessly as hospital helpers: in many respects, the future of medicine is already here.

User comments : 2

Adjust slider to filter visible comments by rank

Display comments: newest first

BSD
5 / 5 (1) Jul 08, 2014
The Finger Reader is brilliant device and is useful to humanity. Contrast this, with Google Glass.

May be Google could stump up some cash for MIT toward the reader development instead.
OceanDeep
5 / 5 (1) Jul 08, 2014
The Finger Reader is brilliant device and is useful to humanity. Contrast this, with Google Glass.

May be Google could stump up some cash for MIT toward the reader development instead.


You're so right. Google Glass is such a weird waste of technology, whereas this finger reader can help so many people.
otero
Jul 08, 2014
This comment has been removed by a moderator.