UH students develop prototype device that translates sign language

Jun 01, 2012
Thanks to a group of University of Houston students, the hearing impaired may soon have an easier time communicating with those who do not understand sign language. During the past semester, students in UH's engineering technology and industrial design programs teamed up to develop the concept and prototype for MyVoice, a device that reads sign language and translates its motions into audible words. Credit: Courtesy of the University of Houston

Too often, communication barriers exist between those who can hear and those who cannot. Sign language has helped bridge such gaps, but many people are still not fluent in its motions and hand shapes.

Thanks to a group of University of Houston students, the hearing impaired may soon have an easier time communicating with those who do not understand sign language. During the past semester, students in UH's engineering technology and industrial design programs teamed up to develop the concept and prototype for MyVoice, a device that reads sign language and translates its motions into audible words. Recently, MyVoice earned first place among student projects at the American Society of (ASEE) - Gulf Southwest Annual Conference.

MyVoiceThe development of MyVoice was through a collaborative senior capstone project for engineering technology students (Anthony Tran, Jeffrey Seto, Omar Gonzalez and Alan Tran) and industrial design students (Rick Salinas, Sergio Aleman and Ya-Han Chen). Overseeing the student teams were Farrokh Attarzadeh, associate professor of engineering technology, and EunSook Kwon, director of UH's industrial design program.

MyVoice's concept focuses on a handheld tool with a built-in microphone, speaker, soundboard, video camera and monitor. It would be placed on a hard surface where it reads a user's sign language movements. Once MyVoice processes the motions, it then translates sign language into space through an . Likewise, it would capture a person's voice and can translate words into sign language, which is projected on its monitor.

The industrial designers researched the application of MyVoice by reaching out to the deaf community to understand the challenges associated with others not understanding . They then designed MyVoice, while the engineering technology had the arduous task of programming the device to translate motion into sound.

"The biggest difficulty was sampling together a databases of images of the sign languages. It involved 200-300 images per sign," Seto said. "The team was ecstatic when the prototype came together."

From its conceptual stage, MyVoice evolved into a prototype that could translate a single phrase: "A good job, Cougars."

"This wasn't just a project we did for a grade," said Aleman, who just graduated from UH. "While designing and developing it, it turned into something very personal. When we got to know members of the deaf community and really understood their challenges, it made this MyVoice very important to all of us."

Since MyVoice's creation and first place prize at the ASEE conference, all of the team members have graduated. Still, Aleman said that the project is not history.

"We got it to work, but we hope to work with someone to implement this as a product," Aleman said. "We want to prove to the community that this will work for the hearing impaired."

"We are proud of such a contribution to society through MyVoice, which breaks the barrier between deaf community and common society," added Attarzadeh.

Explore further: Faster computation of electromagnetic interference on an electronic circuit board

add to favorites email to friend print save as pdf

Related Stories

Sign language speakers' hands, mouths operate separately

Aug 23, 2010

When people are communicating in sign languages, they also move their mouths. But scientists have debated whether mouth movements resembling spoken language are part of the sign itself or are connected directly to English. ...

Deaf children use hands to invent own way of communicating

Feb 15, 2009

Deaf children are able to develop a language-like gesture system by making up hand signs and using homemade systems to increase their communication as they grow, just as children with conventional spoken language, research ...

Recommended for you

A smart prosthetic knee with in-vivo diagnoses

Apr 22, 2014

The task was to develop intelligent prosthetic joints that, via sensors, are capable of detecting early failure long before a patient suffers. EPFL researchers have taken up the challenge.

Old tires become material for new and improved roads

Apr 22, 2014

(Phys.org) —Americans generate nearly 300 million scrap tires every year, according to the Environmental Protection Agency (EPA). Historically, these worn tires often end up in landfills or, when illegally ...

Students take clot-buster for a spin

Apr 21, 2014

(Phys.org) —In the hands of some Rice University senior engineering students, a fishing rod is more than what it seems. For them, it's a way to help destroy blood clots that threaten lives.

User comments : 0

More news stories

Is nuclear power the only way to avoid geoengineering?

"I think one can argue that if we were to follow a strong nuclear energy pathway—as well as doing everything else that we can—then we can solve the climate problem without doing geoengineering." So says Tom Wigley, one ...

US urged to drop India WTO case on solar

Environmentalists Wednesday urged the United States to drop plans to haul India to the WTO to open its solar market, saying the action would hurt the fight against climate change.