The search -- computers dig deeper for meaning (w/ Video)

Nov 02, 2009

(PhysOrg.com) -- Search engine technology is in a state of flux as it digs ever deeper for new meaning. Europe is poised to reap the benefits of the new age of semantic search thanks to the work of European researchers.

‘Search’ is the gateway to the web, it keeps moving, it provides the maps and the shortcuts through the enormous tangle of the .

But while there is a phenomenal amount of content, most of it is not that easy to find. Sure, text content can be skimmed or glanced, but audiovisual content has to be viewed in linear time. We cannot easily search inside a film or audio recording for relevant information.

That is changing, and one European project has created the first integrated platform for semantic search that can return results based on the content and context of film and audio files, as well as text.

Not the end for keywords

This is not the end of keyword search - the standard technology that we use every day - but it could well be the beginning of the end.

For instance, try to compose a meaningful query, such as “effects of military action in civil population”. Traditional search engines will give results for the individual keywords introduced. A semantic engine, like MESH, will analyse the query first and then give relevant results for the actual meaning of the query.

The EU-funded MESH project sought to create a platform that integrated the state of the art in semantic search technologies and all the necessary tools to develop a working platform. But while the team’s achievements are impressive, there is a length of road to travel before they are ready for universal search by everyday surfers like you and I.

Still, the platform proves the technology in two restricted news domains - natural disasters and civil unrest and street violence - and it has led to many useful, working applications and potential commercialisation opportunities.

“We developed a manual annotation tool to create manageable annotations for all types of media, and it is a very strong program that is easy to use,” explains Pedro Concejero, coordinator of the MESH project. This tool could become a commercial product, he predicts.

The search for relevance

One partner of the project, Deutsche Welle, a German TV station, created a dossier-developing tool called Full Story. This remarkable program can help a video editor link to video, audio and text relevant to a particular topic.

The editor can then assemble these diverse elements into a dossier. For example, a dossier about flooding might assemble media outlining the mechanics of flooding, the impact of changing weather patterns, and the effect on lowland and populous areas.

TV stations do this type of feature all the time, and typically it can take days sorting through media archives for useful material to assemble a compelling dossier.

But with the Full Story program, an editor can perform the same task in hours, and the editor is much more likely to find compelling and visually interesting material, because most of the time is spent sorting through relevant results rather than searching for relevant material in a vast warehouse.

“Deutsche Welle is currently evaluating the future prospects of Full Story with further extensive user testing, a comprehensive technology implementation plan and an outline concerning potential commercialisation,” notes Concejero.

Annotating user-generated content

User-generated content is another area that could benefit from the work of the MESH consortium in the short to medium term. User-generated content is a huge element of Web 2.0 applications - it is the material that makes sites like YouTube, flickr, Facebook and Twitter so popular.

The MESH project’s automated annotation tool was central to the platform’s success, and it could be developed to work with user-generated content.

“Here at my company, Telefónica, we are very interested in developing semantic search and annotation for user-generated content on mobile phones, but more work would need to be done on the technology developed in MESH to make it ready for that sort of application,” reveals Concejero.

That may be the work of another project. The consortium has just put the final touches on MESH, but Concejero says that some of the partners may go forward with another project in the future. In the meantime, response from peers and industry to the work of the MESH project has been encouraging.

Above all, the MESH project demonstrates that for all media types is possible and automation is improving rapidly. It’s not quite there yet, but the search continues.

This is the second of a two-part special feature on the MESH project.
Part 1. Listen, watch, read -- computers search for meaning

More information: www.mesh-ip.eu/?Page=Project

Provided by ICT Results

Explore further: Avatars make the Internet sign to deaf people

add to favorites email to friend print save as pdf

Related Stories

Listen, watch, read -- computers search for meaning

Oct 30, 2009

(PhysOrg.com) -- European researchers have created the first integrated semantic search platform that integrates text, video and audio. The system can 'watch' films, 'listen' to audio and 'read' text to find relevant responses ...

Professor working on practical cloaking device (w/ Video)

Aug 20, 2009

(PhysOrg.com) -- A physicist at the University of St Andrews hopes to make major advances in the 'tantalising' field of invisibility in the next two years. Professor Ulf Leonhardt, who cites the Invisible Woman and Harry ...

Recommended for you

Avatars make the Internet sign to deaf people

Aug 29, 2014

It is challenging for deaf people to learn a sound-based language, since they are physically not able to hear those sounds. Hence, most of them struggle with written language as well as with text reading ...

Chameleon: Cloud computing for computer science

Aug 26, 2014

Cloud computing has changed the way we work, the way we communicate online, even the way we relax at night with a movie. But even as "the cloud" starts to cross over into popular parlance, the full potential ...

User comments : 1

Adjust slider to filter visible comments by rank

Display comments: newest first

Szkeptik
not rated yet Nov 02, 2009
I tried wolfram alpha that is something like that, but it was a great letdown. If you don't phrase the question in a certain way you get nothing. If you want to find anything with it first you have to figure out exactly how to ask.