Multimedia search without detours

Apr 02, 2010

Finding a particular song or video is often no easy matter. Manually assigned metadata may be incorrect, and the unpacking of compressed data can slow up the search. DIVAS, a multimedia search engine, uses digital fingerprints to reliably locate what you are looking for.

Fingerprints at the scene of a crime can betray the perpetrator. And digital fingerprints can help to locate video and audio files - a party video on the Internet, an advertising spot in a , or the original version of a film extract in the broadcaster's archive. Fingerprints in can provide information on its tempo, genre or the proportion of rhythmic instruments.

Those used in videos may contain information on scene changes, camera movements and the brightness of the image. In contrast to manually captured metadata, automatically generated fingerprints are never ambiguous. In many archives - for example those of television broadcasters - they are generated when the file is initially stored. This differs from the Internet, where fingerprints have to be recreated with every search. For this purpose, it was previously necessary to decompress compressed files. But that is no longer the case with the multimedia search engine DIVAS, short for direct video & audio content search engine. DIVAS finds the file you are looking for without needing to first unpack the entire media archive.

The search engine is suitable not only for searches on the Internet and in archives, but also for monitoring TV programs, for example to check whether a contractually agreed advertisement has been broadcast. As the software can take "fingerprints" of compressed files, it is faster than comparable search engines.

"Our series of tests with MP3 files showed that search times can be halved," reports Prof. Gerald Schuller of the Fraunhofer Institute for Digital Media Technology IDMT in Ilmenau. Together with Matthias Gruhne he was responsible for developing the audio component of DIVAS, which covers the extraction of fingerprints and the subsequent search. Both of these function even with music files that are recorded from a loudspeaker using a cell phone. "Even if the sound has been severely distorted, our methods make it possible to clearly identify and classify the song," explains Schuller.

The fingerprints are stored in MPEG-7 format, the ISO standard for multimedia data. DIVAS can be used to detect similarities between different video or audio contents as well as for topic-related data searches, for instance to find songs of a certain . The software can handle audio and video formats such as MP3, AAC, H.264 and MPEG-2. DIVAS was the brainchild of an EU-wide joint project in which seven partners from seven different countries took part. They included Belgian television BETV, which plans to use the multimedia search engine in its own archive.

Explore further: Innovative new supercomputers increase nation's computational capacity and capability

add to favorites email to friend print save as pdf

Related Stories

Video fingerprinting offers search solution

Nov 09, 2009

(PhysOrg.com) -- The explosive growth of video on the internet calls for new ways of sorting and searching audiovisual content. A team of European researchers has developed a groundbreaking solution that is ...

Metadata bring order to digital chaos

Sep 10, 2008

MP3 files, video streams, digital images – the flood of multimedia data swells higher every day. New systems help the user to keep tabs on it all. At the International Broadcasting Convention IBC in Amsterdam on September ...

'Quaero' becoming a reality

Mar 20, 2006

Nearly a year after its launch, the European multimedia search engine "Quaero" looks more like a high-tech reality than its critics had initially taken to be.

Blinkx to lead in video search engine

Jul 06, 2006

When it comes to video searching on the Net, blinkx is big. Deeming itself the smartest and largest video search engine on the Web, blinkx.tv delivers 4 million hours of searchable content -- audio, video, and TV via RSS ...

Surround sound on the move

Feb 23, 2007

Surround sound gives you the feeling of being right in the middle of the action. Until now, it took massive data packets to achieve the ultimate sound experience. But at CeBIT, which will take place from March 15 to 21, Fraunhofer ...

Recommended for you

Forging a photo is easy, but how do you spot a fake?

Nov 21, 2014

Faking photographs is not a new phenomenon. The Cottingley Fairies seemed convincing to some in 1917, just as the images recently broadcast on Russian television, purporting to be satellite images showin ...

Algorithm, not live committee, performs author ranking

Nov 21, 2014

Thousands of authors' works enter the public domain each year, but only a small number of them end up being widely available. So how to choose the ones taking center-stage? And how well can a machine-learning ...

Professor proposes alternative to 'Turing Test'

Nov 19, 2014

(Phys.org) —A Georgia Tech professor is offering an alternative to the celebrated "Turing Test" to determine whether a machine or computer program exhibits human-level intelligence. The Turing Test - originally ...

Image descriptions from computers show gains

Nov 18, 2014

"Man in black shirt is playing guitar." "Man in blue wetsuit is surfing on wave." "Black and white dog jumps over bar." The picture captions were not written by humans but through software capable of accurately ...

User comments : 0

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.