NHK develops an automatic sign language translation system for TV (w/ video)

Jun 06, 2011 by Katie Gatto weblog

(PhysOrg.com) -- Researchers at the NHK Science & Technology Research laboratories in Japan have developed a new animated sign language translation system. The system takes a string of words, in Japanese obviously, and converts them into the gestures that make up sign language.

The goal of the project is to create more effective broadcasts for deaf television viewers. The system could be used to allow for more effective communications in the event of a state of emergency or important breaking news, though it does have the potential to be used in entertainment capacity as well.

While there is a current form of communication in place, subtitles, they are not always an effective way of communicating with those who were born deaf, as research has shown that they may have more difficulty understanding the subtitles than they would seeing the message signed. This system can enhance the level of comprehension in the event of a disaster.

The system takes the text, and translates it to signing. The system can also convert the existing words directly to signing and replacing the words that do not have a direct translation with a synonym in order to get the word across. The system then shows the signing done by a virtual avatar that is dressed like a reporter.

Current testing of the system shows that the hearing impaired were able to get a basic message from the system, through the whole message may not be a fluid as a live translator would be in the same situation. The system will still have a built-in manual system where a human can go in and fix the translations for enhanced accuracy.

Explore further: Hackathon team's GoogolPlex gives Siri extra powers

Related Stories

Sign language speakers' hands, mouths operate separately

Aug 23, 2010

When people are communicating in sign languages, they also move their mouths. But scientists have debated whether mouth movements resembling spoken language are part of the sign itself or are connected directly to English. ...

Sign language puzzle solved

Dec 15, 2009

(PhysOrg.com) -- Scientists have known for 40 years that even though it takes longer to use sign language to sign individual words, sentences can be signed, on average, in the same time it takes to say them, ...

Deaf children use hands to invent own way of communicating

Feb 15, 2009

Deaf children are able to develop a language-like gesture system by making up hand signs and using homemade systems to increase their communication as they grow, just as children with conventional spoken language, research ...

Visual system interprets sign languages

Jun 02, 2010

Spanish sign language is used by over 100,000 people with hearing impairments and is made up of hundreds of signs. CVC-UAB researchers Sergio Escalera, Petia Radeva and Jordi Vitria selected over twenty of these signs to ...

Recommended for you

Android gains in US, basic phones almost extinct

9 hours ago

The Google Android platform grabbed the majority of mobile phones in the US market in early 2014, as consumers all but abandoned non-smartphone handsets, a survey showed Friday.

Hackathon team's GoogolPlex gives Siri extra powers

Apr 17, 2014

(Phys.org) —Four freshmen at the University of Pennsylvania have taken Apple's personal assistant Siri to behave as a graduate-level executive assistant which, when asked, is capable of adjusting the temperature ...

Microsoft CEO is driving data-culture mindset

Apr 16, 2014

(Phys.org) —Microsoft's future strategy: is all about leveraging data, from different sources, coming together using one cohesive Microsoft architecture. Microsoft CEO Satya Nadella on Tuesday, both in ...

User comments : 0

More news stories

LinkedIn membership hits 300 million

The career-focused social network LinkedIn announced Friday it has 300 million members, with more than half the total outside the United States.

Researchers uncover likely creator of Bitcoin

The primary author of the celebrated Bitcoin paper, and therefore probable creator of Bitcoin, is most likely Nick Szabo, a blogger and former George Washington University law professor, according to students ...

Impact glass stores biodata for millions of years

(Phys.org) —Bits of plant life encapsulated in molten glass by asteroid and comet impacts millions of years ago give geologists information about climate and life forms on the ancient Earth. Scientists ...