NHK develops an automatic sign language translation system for TV (w/ video)

Jun 06, 2011 by Katie Gatto weblog

(PhysOrg.com) -- Researchers at the NHK Science & Technology Research laboratories in Japan have developed a new animated sign language translation system. The system takes a string of words, in Japanese obviously, and converts them into the gestures that make up sign language.

The goal of the project is to create more effective broadcasts for deaf television viewers. The system could be used to allow for more effective communications in the event of a state of emergency or important breaking news, though it does have the potential to be used in entertainment capacity as well.

While there is a current form of communication in place, subtitles, they are not always an effective way of communicating with those who were born deaf, as research has shown that they may have more difficulty understanding the subtitles than they would seeing the message signed. This system can enhance the level of comprehension in the event of a disaster.

The system takes the text, and translates it to signing. The system can also convert the existing words directly to signing and replacing the words that do not have a direct translation with a synonym in order to get the word across. The system then shows the signing done by a virtual avatar that is dressed like a reporter.

Current testing of the system shows that the hearing impaired were able to get a basic message from the system, through the whole message may not be a fluid as a live translator would be in the same situation. The system will still have a built-in manual system where a human can go in and fix the translations for enhanced accuracy.

Explore further: Mobile app to help fight against racism in France

Related Stories

Sign language speakers' hands, mouths operate separately

Aug 23, 2010

When people are communicating in sign languages, they also move their mouths. But scientists have debated whether mouth movements resembling spoken language are part of the sign itself or are connected directly to English. ...

Sign language puzzle solved

Dec 15, 2009

(PhysOrg.com) -- Scientists have known for 40 years that even though it takes longer to use sign language to sign individual words, sentences can be signed, on average, in the same time it takes to say them, ...

Deaf children use hands to invent own way of communicating

Feb 15, 2009

Deaf children are able to develop a language-like gesture system by making up hand signs and using homemade systems to increase their communication as they grow, just as children with conventional spoken language, research ...

Visual system interprets sign languages

Jun 02, 2010

Spanish sign language is used by over 100,000 people with hearing impairments and is made up of hundreds of signs. CVC-UAB researchers Sergio Escalera, Petia Radeva and Jordi Vitria selected over twenty of these signs to ...

Recommended for you

Mobile app to help fight against racism in France

May 24, 2013

A French anti-racism association is launching a mobile application it hopes will help eradicate racist graffiti by enabling users to take photos of offensive tags, geo-locate them and get them removed.

Google Drive sports new view and scan enhancements

May 23, 2013

(Phys.org) —Google Drive has a new look and functions. The makeover in Google Drive features scanning and interface enhancements that put the user into "card" mode. The enhancements make it easy for the ...

Model will unlock mysteries of the voice

May 22, 2013

Swedish researchers are leading the development of the world's first comprehensive model of the human voice, which could contribute to better voice care, voice prosthetics, talking robots and teaching opportunities.

Patented system better secures digitally stored data

May 21, 2013

(Phys.org) —Arizona State University computer scientist Gail-Joon Ahn has been granted a U.S. patent for a novel identity management system that helps protect personal identity information stored on digital devices.

UC Davis startup changes listening experience

May 20, 2013

Fifteen years of research at the University of California, Davis, is being turned into commercial products by Dysonics, a startup company based in San Francisco. Since becoming the first "graduate" from the Engineering Translational ...

User comments : 0

More news stories

Yahoo, pay-TV operators among Hulu bidders

Online video site Hulu is again up for sale, with Yahoo and pay TV operators DirecTV and Time Warner Cable among the seven bidders, according to a person with direct knowledge of the matter.

Radiation leak at Japan lab; small impact expected

An atomic research lab in northern Japan has reported a radiation leak that may have affected about 50 people, though none were hospitalized and no impact was expected outside the facility, the lab's operator ...