NHK develops an automatic sign language translation system for TV (w/ video)

Jun 06, 2011 by Katie Gatto weblog

(PhysOrg.com) -- Researchers at the NHK Science & Technology Research laboratories in Japan have developed a new animated sign language translation system. The system takes a string of words, in Japanese obviously, and converts them into the gestures that make up sign language.

The goal of the project is to create more effective broadcasts for deaf television viewers. The system could be used to allow for more effective communications in the event of a state of emergency or important breaking news, though it does have the potential to be used in entertainment capacity as well.

While there is a current form of communication in place, subtitles, they are not always an effective way of communicating with those who were born deaf, as research has shown that they may have more difficulty understanding the subtitles than they would seeing the message signed. This system can enhance the level of comprehension in the event of a disaster.

The system takes the text, and translates it to signing. The system can also convert the existing words directly to signing and replacing the words that do not have a direct translation with a synonym in order to get the word across. The system then shows the signing done by a virtual avatar that is dressed like a reporter.

Current testing of the system shows that the hearing impaired were able to get a basic message from the system, through the whole message may not be a fluid as a live translator would be in the same situation. The system will still have a built-in manual system where a human can go in and fix the translations for enhanced accuracy.

Explore further: Catch the northern lights with your mobile

Related Stories

Sign language speakers' hands, mouths operate separately

Aug 23, 2010

When people are communicating in sign languages, they also move their mouths. But scientists have debated whether mouth movements resembling spoken language are part of the sign itself or are connected directly to English. ...

Sign language puzzle solved

Dec 15, 2009

(PhysOrg.com) -- Scientists have known for 40 years that even though it takes longer to use sign language to sign individual words, sentences can be signed, on average, in the same time it takes to say them, ...

Deaf children use hands to invent own way of communicating

Feb 15, 2009

Deaf children are able to develop a language-like gesture system by making up hand signs and using homemade systems to increase their communication as they grow, just as children with conventional spoken language, research ...

Visual system interprets sign languages

Jun 02, 2010

Spanish sign language is used by over 100,000 people with hearing impairments and is made up of hundreds of signs. CVC-UAB researchers Sergio Escalera, Petia Radeva and Jordi Vitria selected over twenty of these signs to ...

Recommended for you

Google's Waze app endangers police: LAPD chief

8 hours ago

Google's newly acquired Waze application poses a danger to police because of its ability to track their locations, the Los Angeles police chief said in a letter to the tech company's CEO.

Catch the northern lights with your mobile

Jan 26, 2015

Updates on the best opportunities to spot the Northern Lights in the UK are now available on a mobile phone app developed in association with scientists at Lancaster University.

App improves the safety of blind pedestrians in cities

Jan 22, 2015

Siemens is developing a system that helps blind and visually impaired people walk safely through cities. In cooperation with the Technical University of Braunschweig and several partners, Siemens is working ...

Nadella: Microsoft aspires to get consumers 'loving Windows'

Jan 22, 2015

Microsoft upped its bid to capture the hearts and minds of technology consumers Wednesday with Windows 10, announcing everything from free upgrades for the majority of Windows users to support for nascent holographic dis ...

User comments : 0

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.