Microsoft researchers use social media to teach Skype how to translate languages in real-time

Aug 26, 2014 by Bob Yirka weblog
Gurdeep Pall, Microsoft corporate vice president of Skype and Lync, demos the new Skype Translator app while Re/code’s Walt Mossberg and Kara Swisher look on. Credit: Microsoft

(Phys.org) —A few months ago, Microsoft made headlines by announcing at Code Conference that Skype would soon be able to translate language between speakers in real time—that product, which Microsoft calls simply Skype Translator, if successful will be the first real time language translator—a primitive version of the Universal Translator of Star Trek fame. The demo showed two people talking in real time using Skype—one in English, the other German. The words by the speakers were displayed as translated text on each other's screen and were also played aloud by a voice generator that allowed the listener, to listen in their own language. Now new details of how Microsoft has achieved this feat are coming out, and some of them are a little surprising.

Representatives with Microsoft have revealed that the main "trick" in real-time language translation is recognizing the difference between spoken and written languages. When people talk, they note, they use all manner of cues to convey meaning—they hem and hah, and use words like um to give them more time to respond. They also pronounce words differently, using tone changes to convey added information, such as whether what they are saying is a statement, or a question. To build their translator, Microsoft started by feeding text from books and articles into a designed to tear sentences apart looking for meaning in smaller phrases—and then mapping them to similar phrases in the target language. That approach led to some advancements in the neural network (learning part of the software) but more work still needed to be done. It turns out, Microsoft engineers looked to social media sites because of the unique language structure used by the people who use them to convey meaning in a way that is more like conversation than typical written documents.

Because the different social media sites tend to have their own language characteristics, Microsoft started by writing software that could normalize posts from the various sites, arriving at a common format. Adding the normalized data to the original software engine led to a dramatic improvement in the sound of conversational , and it's what users will hear once Skype Translator is finally released as a beta app for Windows 8 by the end of this year.


Explore further: Microsoft claims breakthrough in real-time translation

More information: vie IEEE

add to favorites email to friend print save as pdf

Related Stories

How arbitrary is language?

Aug 14, 2014

Words in the English language are structured to help children learn according to research led by Lancaster University.

Bilingual avatar speaks Mundie language

Mar 10, 2012

(PhysOrg.com) -- This week's Microsoft Big Idea event, TechFest 2012, presented the latest advances on the part of researchers at Microsoft. A bilingual talking head received much of the attention. Called ...

Microsoft's Yammer adds translation functions

Feb 28, 2013

Microsoft said Thursday its Yammer social network for internal corporate communications would add message translation capabilities to help firms with multilingual operations.

Recommended for you

Microsoft beefs up security protection in Windows 10

19 hours ago

What Microsoft users in business care deeply about—-a system architecture that supports efforts to get their work done efficiently; a work-centric menu to quickly access projects rather than weather readings ...

Team infuses science into 'Minecraft' modification

Oct 24, 2014

The 3-D world of the popular "Minecraft" video game just became more entertaining, perilous and educational, thanks to a comprehensive code modification kit, "Polycraft World," created by University of Texas at Dallas professors, ...

Microsoft's Garage becomes an incubator of consumer apps

Oct 24, 2014

For five years now, The Garage has served as Microsoft's incubator for employees' passion projects, an internal community of engineers, designers, hardware tinkerers and others from all different parts of the company who ...

Students win challenge for real-time traffic app

Oct 24, 2014

Three University of Texas at Arlington Computer Science and Engineering students have won a $10,000 prize in the NTx Apps Challenge for a smart traffic light network that adjusts traffic light schedules to ...

User comments : 3

Adjust slider to filter visible comments by rank

Display comments: newest first

Squirrel
not rated yet Aug 26, 2014
One of the biggest revolutions in human history--the Tower of Babble rebuilt.
pntaylor
not rated yet Aug 26, 2014
Yep, Squirrel, you're not gnawing our nuts on that one.
veritas1989
not rated yet Aug 27, 2014
sooo.... learning english all these years was for nothing? ;)

I am working in a Company using Skype for internal Team Communication. One of them is in located in Sizilia Italy(very strong italian accent). So I wonder how the programm is responding to specific areas like sizilia or germany bavaria, german austria with distinct accents.