Undergraduate team wins Lemelson-MIT Student Prize for gloves that translate sign language

April 12, 2016 by Jennifer Langston, University of Washington
Each glove contains sensors that record hand position and movement and transmit data wirelessly to a central computer, which uses algorithms to recognize and translate sign language gestures. Credit: University of Washington

Two University of Washington undergraduates have won a $10,000 Lemelson-MIT Student Prize for gloves that can translate sign language into text or speech.

The Lemelson-MIT Student Prize is a nationwide search for the most inventive undergraduate and graduate students. This year, UW sophomores Navid Azodi and Thomas Pryor—who are studying business administration and aeronautics and astronautics engineering, respectively—won the "Use It" undergraduate category that recognizes technology-based inventions to improve consumer devices.

Their invention, "SignAloud," is a pair of gloves that can recognize hand gestures that correspond to words and phrases in American Sign Language. Each glove contains sensors that record hand position and movement and send data wirelessly via Bluetooth to a central computer. The computer looks at the gesture data through various sequential statistical regressions, similar to a neural network. If the data match a gesture, then the associated word or phrase is spoken through a speaker.

They honed their prototype in the UW CoMotion MakerSpace—a campus space that offers communal tools and equipment and opportunities for students to tinker, create and innovate. For Azodi and Pryor, that meant finding a way to translate American Sign Language into a verbal form instantaneously and in an ergonomic fashion.

"Many of the translation devices already out there are not practical for everyday use. Some use video input, while others have sensors that cover the user's entire arm or body," said Pryor, an undergraduate researcher in the Composite Structures Laboratory in the Department of Aeronautics & Astronautics and software lead for the Husky Robotics Team.

"Our gloves are lightweight, compact and worn on the hands, but ergonomic enough to use as an everyday accessory, similar to hearing aids or contact lenses," said Pryor.

UW sophomore Thomas Pryor demonstrates the 'SignAloud' gloves that he developed with fellow student Navid Azodi, which can translate American Sign Language into text and speech. Credit: University of Washington

The duo met in the dorms during their freshman year and discovered they both had a passion for invention and problem solving. Azodi has technical experience as a systems intern at NASA, a technology lead for UW Information Technology and a campus representative for Apple. His long history of volunteer work—which includes organizing dozens of blood drives and working with Seattle Union Gospel Mission, Northwest Harvest and Ethiopia Reads—gave motivation to build a device that would have real-world impact.

"Our purpose for developing these gloves was to provide an easy-to-use bridge between native speakers of American Sign Language and the rest of the world," Azodi said. "The idea initially came out of our shared interest in invention and problem solving. But coupling it with our belief that communication is a fundamental human right, we set out to make it more accessible to a larger audience."

The team received support and mentoring from Mike Clarke, who manages the CoMotion MakerSpace and met the students after one asked for help with some soldering equipment that turned out to be broken.

Navid Azodi (left) and Thomas Pryor (right) refine their SignAloud system in the UW CoMotion MakerSpace, where they developed the award-winning technology. Credit: University of Washington
"We disassembled it and fixed it together while talking about their sign language translation project. I recognized from working and talking with Thomas and Navid that they were standouts and that the invention they made was really impressive," Clarke said.

Pryor and Azodi's first target audience is the deaf and hard-of-hearing community and those interested in learning and working with American Sign Language. But the gloves could also be commercialized for use in other fields, including medical technology to monitor stroke patients during rehabilitation, gesture control and enhanced dexterity in virtual reality.

Their "Use It" Student Prize is one of seven awarded by the Lemelson-MIT Program this year. Each winning team of undergraduates will receive $10,000, and each graduate student winner will receive $15,000. The winners of this year's competition were selected from a diverse and highly competitive applicant pool of students from 77 colleges and universities across the country.

"This year's Lemelson-MIT Student Prize winners have outstanding portfolios of inventive work," said Lemelson-MIT Program faculty director Michael Cima. "Their passion for solving problems through invention is matched by their commitment to mentoring the next generation of inventors." Students interested in applying for the 2017 Lemelson-MIT Student Prize can complete this interest form.

Explore further: Stanford professor wins $500K MIT invention prize

Related Stories

Recommended for you

Semimetals are high conductors

March 18, 2019

Researchers in China and at UC Davis have measured high conductivity in very thin layers of niobium arsenide, a type of material called a Weyl semimetal. The material has about three times the conductivity of copper at room ...

2 comments

Adjust slider to filter visible comments by rank

Display comments: newest first

studioj
not rated yet Apr 12, 2016
I was right with these two and excited about their approach to problem solving until the moment they called communication a basic human right. It's not. Perhaps that so many people take communication to be a right is why most of we humans perform so poorly at the task. Communication is a privilege. It is a skill and like any other skill can be improved with dedication, and practice. An infant communicates with coos and screams but with time and practice, learns to articulate complex thoughts in ways others can understand. People who have impairments that make communication difficult appreciate this most cherished privilege and do not take it for granted. Let's not confuse rights and privileges.
Coolbluez
not rated yet Apr 16, 2016
This has been in use in Pakistan since 2004. The students who developed this project published their findings in the paper titled 'Assistive Glove for Pakistani Sign Language Translation Pakistani Sign Language Translator'.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.