Microsoft researchers use social media to teach Skype how to translate languages in real-time

Aug 26, 2014 by Bob Yirka weblog
Gurdeep Pall, Microsoft corporate vice president of Skype and Lync, demos the new Skype Translator app while Re/code’s Walt Mossberg and Kara Swisher look on. Credit: Microsoft

( —A few months ago, Microsoft made headlines by announcing at Code Conference that Skype would soon be able to translate language between speakers in real time—that product, which Microsoft calls simply Skype Translator, if successful will be the first real time language translator—a primitive version of the Universal Translator of Star Trek fame. The demo showed two people talking in real time using Skype—one in English, the other German. The words by the speakers were displayed as translated text on each other's screen and were also played aloud by a voice generator that allowed the listener, to listen in their own language. Now new details of how Microsoft has achieved this feat are coming out, and some of them are a little surprising.

Representatives with Microsoft have revealed that the main "trick" in real-time language translation is recognizing the difference between spoken and written languages. When people talk, they note, they use all manner of cues to convey meaning—they hem and hah, and use words like um to give them more time to respond. They also pronounce words differently, using tone changes to convey added information, such as whether what they are saying is a statement, or a question. To build their translator, Microsoft started by feeding text from books and articles into a designed to tear sentences apart looking for meaning in smaller phrases—and then mapping them to similar phrases in the target language. That approach led to some advancements in the neural network (learning part of the software) but more work still needed to be done. It turns out, Microsoft engineers looked to social media sites because of the unique language structure used by the people who use them to convey meaning in a way that is more like conversation than typical written documents.

Because the different social media sites tend to have their own language characteristics, Microsoft started by writing software that could normalize posts from the various sites, arriving at a common format. Adding the normalized data to the original software engine led to a dramatic improvement in the sound of conversational , and it's what users will hear once Skype Translator is finally released as a beta app for Windows 8 by the end of this year.

Explore further: Microsoft claims breakthrough in real-time translation

More information: vie IEEE

Related Stories

How arbitrary is language?

Aug 14, 2014

Words in the English language are structured to help children learn according to research led by Lancaster University.

Bilingual avatar speaks Mundie language

Mar 10, 2012

( -- This week's Microsoft Big Idea event, TechFest 2012, presented the latest advances on the part of researchers at Microsoft. A bilingual talking head received much of the attention. Called ...

Microsoft's Yammer adds translation functions

Feb 28, 2013

Microsoft said Thursday its Yammer social network for internal corporate communications would add message translation capabilities to help firms with multilingual operations.

Recommended for you

Yik Yak's frat-bro founders shrug off growing pains

8 hours ago

The most popular post of all time on Yik Yak is a dirty joke. Less than 2 years old, the Atlanta-based social network is geared mostly toward college students who access and post unsigned announcements through an app on their ...

User comments : 3

Adjust slider to filter visible comments by rank

Display comments: newest first

not rated yet Aug 26, 2014
One of the biggest revolutions in human history--the Tower of Babble rebuilt.
not rated yet Aug 26, 2014
Yep, Squirrel, you're not gnawing our nuts on that one.
not rated yet Aug 27, 2014
sooo.... learning english all these years was for nothing? ;)

I am working in a Company using Skype for internal Team Communication. One of them is in located in Sizilia Italy(very strong italian accent). So I wonder how the programm is responding to specific areas like sizilia or germany bavaria, german austria with distinct accents.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.