Software maps ambiguous names in texts to the right person

Feb 26, 2014
Software maps ambiguous names in texts to the right person
A new technique enables it to query documents by means of keywords, entities, and categories. Credit: Johannes Hoffart/Max Planck Institute

If a name is ambiguous and given without context, even humans struggle. When reading the last name "Merkel", people do not know if it refers to the Chancellor of Germany Angela Merkel or the famous soccer coach Max Merkel. It is a drawback for web search, too. Up to now, the programs can capture character strings like "Angela Merkel", but they do not pay attention to attributes like "German Chancellor" or "Germany's First Lady" at all. Even worse, after the word "Merkel" is entered, the search engines provide information about a lot of people with the same last name.

Researchers at the Max Planck Institute for Informatics have now developed a program that enables accurate disambiguation of named entities by analyzing them with the help of the free Internet encyclopedia Wikipedia. Their software named AIDA establishes connections between the mentions in the text and potential persons or places. "The more references exist between a mention and a specific person in Wikipedia, the more words of the person's Wikipedia article can also be found in the input text, and the higher the score the mention-entity edge receives. AIDA checks this score and selects the mention-entity edge with the highest score as the accurate mapping," explains Johannes Hoffart, who co-developed AIDA at the Max Planck Institute for Informatics.

To demonstrate their novel technique, the researchers have implemented a search engine based on their approach. The makes it possible not only to combine the search for strings with the search for specific objects like persons and locations, but also to search on categories. In this way, the search for "Angela Merkel + phone call + Ukrainian politicians" results in texts dealing with the German Chancellor within the context of Ukrainian politicians like "Yulia Tymoshenko" and the string "phone call". Currently the researchers use AIDA to analyze the text corpus of the German National Library to combine the search for keywords with the search for specific objects. "The search results are more precise this way", Hoffart points out.

"With our new technique we can not only build better search engines, but also make computers understand texts almost as a human does, in an efficient way," explains Gerhard Weikum, Scientific Director at the Max Planck Institute for Informatics in Saarbrücken. The approach also opens new possibilities for automatically generated recommendations and the analysis of datasets, says Weikum, who also does research at the Cluster of Excellence "Multimodal Computing and Interaction" in Saarbrücken. "Whoever is a fan of the soccer coach Merkel will receive recommendations for his books. Those more interested in the Chancellor get referred to books dealing with her and her way of governing Germany," Weikum explains.

Explore further: German prosecutor: Still weighing NSA probe

add to favorites email to friend print save as pdf

Related Stories

German prosecutor: Still weighing NSA probe

Dec 11, 2013

Germany's chief federal prosecutor says he hasn't decided whether to open an investigation into alleged surveillance by the U.S. National Security Agency but is suggesting that he's skeptical.

German official doubtful on binding no-spy deal

Feb 13, 2014

The German government's new coordinator for trans-Atlantic relations says he doubts talks aimed at securing a "no-spy" agreement with the U.S. will produce a deal that's legally binding.

Merkel cautious on 'fracking' in Germany

Feb 20, 2013

Chancellor Angela Merkel on Wednesday expressed caution over whether the revolutionary oil and gas technique of "fracking" could be introduced in Germany, saying public safety was the main concern.

Hackers sue German government over NSA spying

Feb 03, 2014

A group of computer hackers and human rights campaigners in Germany announced Monday that they are suing their government for allegedly breaking the law by aiding foreign spies.

Recommended for you

Study: Social media users shy away from opinions

Aug 26, 2014

People on Facebook and Twitter say they are less likely to share their opinions on hot-button issues, even when they are offline, according to a surprising new survey by the Pew Research Center.

US warns shops to watch for customer data hacking

Aug 23, 2014

The US Department of Homeland Security on Friday warned businesses to watch for hackers targeting customer data with malicious computer code like that used against retail giant Target.

Fitbit to Schumer: We don't sell personal data

Aug 22, 2014

The maker of a popular line of wearable fitness-tracking devices says it has never sold personal data to advertisers, contrary to concerns raised by U.S. Sen. Charles Schumer.

Should you be worried about paid editors on Wikipedia?

Aug 22, 2014

Whether you trust it or ignore it, Wikipedia is one of the most popular websites in the world and accessed by millions of people every day. So would you trust it any more (or even less) if you knew people ...

How much do we really know about privacy on Facebook?

Aug 22, 2014

The recent furore about the Facebook Messenger app has unearthed an interesting question: how far are we willing to allow our privacy to be pushed for our social connections? In the case of the Facebook ...

Philippines makes arrests in online extortion ring

Aug 22, 2014

Philippine police have arrested eight suspected members of an online syndicate accused of blackmailing more than 1,000 Hong Kong and Singapore residents after luring them into exposing themselves in front of webcam, an official ...

User comments : 0