Microsoft researchers use social media to teach Skype how to translate languages in real-time

August 26, 2014 by Bob Yirka weblog
Gurdeep Pall, Microsoft corporate vice president of Skype and Lync, demos the new Skype Translator app while Re/code’s Walt Mossberg and Kara Swisher look on. Credit: Microsoft

(Phys.org) —A few months ago, Microsoft made headlines by announcing at Code Conference that Skype would soon be able to translate language between speakers in real time—that product, which Microsoft calls simply Skype Translator, if successful will be the first real time language translator—a primitive version of the Universal Translator of Star Trek fame. The demo showed two people talking in real time using Skype—one in English, the other German. The words by the speakers were displayed as translated text on each other's screen and were also played aloud by a voice generator that allowed the listener, to listen in their own language. Now new details of how Microsoft has achieved this feat are coming out, and some of them are a little surprising.

Representatives with Microsoft have revealed that the main "trick" in real-time language translation is recognizing the difference between spoken and written languages. When people talk, they note, they use all manner of cues to convey meaning—they hem and hah, and use words like um to give them more time to respond. They also pronounce words differently, using tone changes to convey added information, such as whether what they are saying is a statement, or a question. To build their translator, Microsoft started by feeding text from books and articles into a designed to tear sentences apart looking for meaning in smaller phrases—and then mapping them to similar phrases in the target language. That approach led to some advancements in the neural network (learning part of the software) but more work still needed to be done. It turns out, Microsoft engineers looked to social media sites because of the unique language structure used by the people who use them to convey meaning in a way that is more like conversation than typical written documents.

Because the different social media sites tend to have their own language characteristics, Microsoft started by writing software that could normalize posts from the various sites, arriving at a common format. Adding the normalized data to the original software engine led to a dramatic improvement in the sound of conversational , and it's what users will hear once Skype Translator is finally released as a beta app for Windows 8 by the end of this year.

Explore further: Bilingual avatar speaks Mundie language

More information: vie IEEE

Related Stories

Bilingual avatar speaks Mundie language

March 10, 2012

(PhysOrg.com) -- This week's Microsoft Big Idea event, TechFest 2012, presented the latest advances on the part of researchers at Microsoft. A bilingual talking head received much of the attention. Called "Monolingual TTS," ...

Microsoft's Yammer adds translation functions

February 28, 2013

Microsoft said Thursday its Yammer social network for internal corporate communications would add message translation capabilities to help firms with multilingual operations.

How arbitrary is language?

August 14, 2014

Words in the English language are structured to help children learn according to research led by Lancaster University.

Recommended for you

How to curb emissions? Put a price on carbon

September 3, 2015

Literally putting a price on carbon pollution and other greenhouse gasses is the best approach for nurturing the rapid growth of renewable energy and reducing emissions.

Customizing 3-D printing

September 3, 2015

The technology behind 3-D printing is growing more and more common, but the ability to create designs for it is not. Any but the simplest designs require expertise with computer-aided design (CAD) applications, and even for ...

Team develops targeted drug delivery to lung

September 2, 2015

Researchers from Columbia Engineering and Columbia University Medical Center (CUMC) have developed a new method that can target delivery of very small volumes of drugs into the lung. Their approach, in which micro-liters ...

Magnetic fields provide a new way to communicate wirelessly

September 1, 2015

Electrical engineers at the University of California, San Diego demonstrated a new wireless communication technique that works by sending magnetic signals through the human body. The new technology could offer a lower power ...

3 comments

Adjust slider to filter visible comments by rank

Display comments: newest first

Squirrel
not rated yet Aug 26, 2014
One of the biggest revolutions in human history--the Tower of Babble rebuilt.
pntaylor
not rated yet Aug 26, 2014
Yep, Squirrel, you're not gnawing our nuts on that one.
veritas1989
not rated yet Aug 27, 2014
sooo.... learning english all these years was for nothing? ;)

I am working in a Company using Skype for internal Team Communication. One of them is in located in Sizilia Italy(very strong italian accent). So I wonder how the programm is responding to specific areas like sizilia or germany bavaria, german austria with distinct accents.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.