NHK develops an automatic sign language translation system for TV (w/ video)

Jun 06, 2011 by Katie Gatto weblog

(PhysOrg.com) -- Researchers at the NHK Science & Technology Research laboratories in Japan have developed a new animated sign language translation system. The system takes a string of words, in Japanese obviously, and converts them into the gestures that make up sign language.

The goal of the project is to create more effective broadcasts for deaf television viewers. The system could be used to allow for more effective communications in the event of a state of emergency or important breaking news, though it does have the potential to be used in entertainment capacity as well.

While there is a current form of communication in place, subtitles, they are not always an effective way of communicating with those who were born deaf, as research has shown that they may have more difficulty understanding the subtitles than they would seeing the message signed. This system can enhance the level of comprehension in the event of a disaster.

The system takes the text, and translates it to signing. The system can also convert the existing words directly to signing and replacing the words that do not have a direct translation with a synonym in order to get the word across. The system then shows the signing done by a virtual avatar that is dressed like a reporter.

Current testing of the system shows that the hearing impaired were able to get a basic message from the system, through the whole message may not be a fluid as a live translator would be in the same situation. The system will still have a built-in manual system where a human can go in and fix the translations for enhanced accuracy.

Explore further: Virtual rape in Grand Theft Auto 5: learning the limits of the game

Related Stories

Sign language speakers' hands, mouths operate separately

Aug 23, 2010

When people are communicating in sign languages, they also move their mouths. But scientists have debated whether mouth movements resembling spoken language are part of the sign itself or are connected directly to English. ...

Sign language puzzle solved

Dec 15, 2009

(PhysOrg.com) -- Scientists have known for 40 years that even though it takes longer to use sign language to sign individual words, sentences can be signed, on average, in the same time it takes to say them, ...

Deaf children use hands to invent own way of communicating

Feb 15, 2009

Deaf children are able to develop a language-like gesture system by making up hand signs and using homemade systems to increase their communication as they grow, just as children with conventional spoken language, research ...

Visual system interprets sign languages

Jun 02, 2010

Spanish sign language is used by over 100,000 people with hearing impairments and is made up of hundreds of signs. CVC-UAB researchers Sergio Escalera, Petia Radeva and Jordi Vitria selected over twenty of these signs to ...

Recommended for you

Developers explore game experience for the blind

1 hour ago

Wait, researchers are talking about a video game for the blind? Come again? Not impossible. Game designers, reports the BBC, have been working on bringing the game experience to the blind and those with vision ...

User comments : 0