The search -- computers dig deeper for meaning (w/ Video)

November 2, 2009

( -- Search engine technology is in a state of flux as it digs ever deeper for new meaning. Europe is poised to reap the benefits of the new age of semantic search thanks to the work of European researchers.

‘Search’ is the gateway to the web, it keeps moving, it provides the maps and the shortcuts through the enormous tangle of the .

But while there is a phenomenal amount of content, most of it is not that easy to find. Sure, text content can be skimmed or glanced, but audiovisual content has to be viewed in linear time. We cannot easily search inside a film or audio recording for relevant information.

That is changing, and one European project has created the first integrated platform for semantic search that can return results based on the content and context of film and audio files, as well as text.

Not the end for keywords

This is not the end of keyword search - the standard technology that we use every day - but it could well be the beginning of the end.

For instance, try to compose a meaningful query, such as “effects of military action in civil population”. Traditional search engines will give results for the individual keywords introduced. A semantic engine, like MESH, will analyse the query first and then give relevant results for the actual meaning of the query.

The EU-funded MESH project sought to create a platform that integrated the state of the art in semantic search technologies and all the necessary tools to develop a working platform. But while the team’s achievements are impressive, there is a length of road to travel before they are ready for universal search by everyday surfers like you and I.

Still, the platform proves the technology in two restricted news domains - natural disasters and civil unrest and street violence - and it has led to many useful, working applications and potential commercialisation opportunities.

“We developed a manual annotation tool to create manageable annotations for all types of media, and it is a very strong program that is easy to use,” explains Pedro Concejero, coordinator of the MESH project. This tool could become a commercial product, he predicts.

The search for relevance

One partner of the project, Deutsche Welle, a German TV station, created a dossier-developing tool called Full Story. This remarkable program can help a video editor link to video, audio and text relevant to a particular topic.

The editor can then assemble these diverse elements into a dossier. For example, a dossier about flooding might assemble media outlining the mechanics of flooding, the impact of changing weather patterns, and the effect on lowland and populous areas.

TV stations do this type of feature all the time, and typically it can take days sorting through media archives for useful material to assemble a compelling dossier.

But with the Full Story program, an editor can perform the same task in hours, and the editor is much more likely to find compelling and visually interesting material, because most of the time is spent sorting through relevant results rather than searching for relevant material in a vast warehouse.

“Deutsche Welle is currently evaluating the future prospects of Full Story with further extensive user testing, a comprehensive technology implementation plan and an outline concerning potential commercialisation,” notes Concejero.

Annotating user-generated content

User-generated content is another area that could benefit from the work of the MESH consortium in the short to medium term. User-generated content is a huge element of Web 2.0 applications - it is the material that makes sites like YouTube, flickr, Facebook and Twitter so popular.

The MESH project’s automated annotation tool was central to the platform’s success, and it could be developed to work with user-generated content.

“Here at my company, Telefónica, we are very interested in developing semantic search and annotation for user-generated content on mobile phones, but more work would need to be done on the technology developed in MESH to make it ready for that sort of application,” reveals Concejero.

That may be the work of another project. The consortium has just put the final touches on MESH, but Concejero says that some of the partners may go forward with another project in the future. In the meantime, response from peers and industry to the work of the MESH project has been encouraging.

Above all, the MESH project demonstrates that for all media types is possible and automation is improving rapidly. It’s not quite there yet, but the search continues.

This is the second of a two-part special feature on the MESH project.
Part 1. Listen, watch, read -- computers search for meaning

More information:

Provided by ICT Results

Explore further: Listen, watch, read -- computers search for meaning

Related Stories

Listen, watch, read -- computers search for meaning

October 30, 2009

( -- European researchers have created the first integrated semantic search platform that integrates text, video and audio. The system can 'watch' films, 'listen' to audio and 'read' text to find relevant responses ...

Professor working on practical cloaking device (w/ Video)

August 20, 2009

( -- A physicist at the University of St Andrews hopes to make major advances in the 'tantalising' field of invisibility in the next two years. Professor Ulf Leonhardt, who cites the Invisible Woman and Harry ...

Recommended for you

Permanent, wireless self-charging system using NIR band

October 8, 2018

As wearable devices are emerging, there are numerous studies on wireless charging systems. Here, a KAIST research team has developed a permanent, wireless self-charging platform for low-power wearable electronics by converting ...

Facebook launches AI video-calling device 'Portal'

October 8, 2018

Facebook on Monday launched a range of AI-powered video-calling devices, a strategic revolution for the social network giant which is aiming for a slice of the smart speaker market that is currently dominated by Amazon and ...

Artificial enzymes convert solar energy into hydrogen gas

October 4, 2018

In a new scientific article, researchers at Uppsala University describe how, using a completely new method, they have synthesised an artificial enzyme that functions in the metabolism of living cells. These enzymes can utilize ...

1 comment

Adjust slider to filter visible comments by rank

Display comments: newest first

not rated yet Nov 02, 2009
I tried wolfram alpha that is something like that, but it was a great letdown. If you don't phrase the question in a certain way you get nothing. If you want to find anything with it first you have to figure out exactly how to ask.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.