Smart search engines for news videos

January 7, 2013
NewsHistory makes the most of user knowledge, searching through video databases to find video sequences with identical content. Credit: Fraunhofer IDMT

Searching for video recordings regularly pushes search engines to their limit. The truth of the matter is that purely automatic algorithms are not enough; user knowledge has to be harnessed, too. Now, researchers are making automated engines smarter.

Anyone who has visited one of the big online or TV broadcasters' media libraries to search for a video clip is already familiar with the search engines tasked with seeking out and flagging . However, these engines have their weaknesses. Their results are based on automatic search algorithms that often go by text-based information alone. Although they can be used to locate and identify videos, a comparison of individual is still very difficult. To make search engines even smarter, the Fraunhofer Institute for IDMT in Ilmenau has developed a piece of software called "NewsHistory" that will now make full use of user knowledge as well. Researchers will be presenting an initial demonstration version of the smart at the trade fair in Hannover from March 5-9, 2013 (Hall 9, Booth E08).

Technology learns from users

"NewsHistory provides users with search algorithms, a data model and a web-based user interface so that they can locate identical sequences within various news videos," explains Patrick Aichroth from Fraunhofer IDMT. He is responsible for coordinating the institute's R&D work within the EU's CUbRIK project. Here, researchers are harnessing user knowledge to optimize and extend the capabilities of automated analysis techniques. "The search engine learns from each individual user, allowing it to keep im-
proving search results. Not only does this improve the quality of results, but the re-
sources needed to undertake the analysis are also cut down," Aichroth continues.

NewsHistory allows each user to add additional information to the results generated by the search engine, including production and broadcast date, sources and keywords for videos. It is also possible to rate the results. Finally, the user's search itself is a source of information, providing data that is incorporated into the search engine; the metadata of a newly uploaded video, for instance, passes into the database.

"Comparing digital video data online or within video databases is very complex," explains Christian Weigel from the Audio-Visual Systems research group at the IDMT. "Videos that share the same content have for the most part been edited, meaning that they are scaled and encoded in a variety of formats. Also, search engines are often unable to distinguish images cropped from a larger picture, lower thirds or the zoom shots so popular with US news channels."

The demonstration version being presented at CeBIT will investigate how a selection of TV channels have made use of film footage, changed its form and broadcast it. The user interface displays commonalities and appraises them in graphic form. The itself is conducted either by inputting text or by directly uploading individual video se-
quences. The researchers' aim is to make the software sufficiently robust that it could also be used in the future to compare the multimedia content found on big online media portals. The scientists do not imagine archivists or journalists will be the only users. "NewsHistory is of particular interest to media and market researchers, say if they want to assess the televised political duels coming up this year," concludes Weigel.

Explore further: Blinkx at work on search engine for online video

Related Stories

Multimedia search without detours

April 2, 2010

Finding a particular song or video is often no easy matter. Manually assigned metadata may be incorrect, and the unpacking of compressed data can slow up the search. DIVAS, a multimedia search engine, uses digital fingerprints ...

iSchool prof predicts the future of search user interfaces

November 7, 2011

School of Information professor Marti Hearst predicts the future of online search interfaces in an article in this month’s edition of the Communications of the ACM. “The future of user interfaces will involve ...

Search engine branding to be examined by researcher

June 11, 2008

Like other industries, companies that maintain search engines must work harder to recruit and retain customers. One way to do this is branding -- creating a cognitive impression that a user is likely to retain and rely on ...

VuNow Sends Free Internet Video Directly to Your TV

December 31, 2008

Verismo's VuNow is an affordable solution for video lovers that sends free internet video content directly to your Television set. VuNow only takes a minute to connect, just plug in the AC power, connect your A/V or HDMI ...

Search engine mashup

July 6, 2007

A mashup of two different types of web search tools could make find the useful nuggets of information among all the grit on the Internet much easier.

Recommended for you

Samsung to disable Note 7 phones in recall effort

December 9, 2016

Samsung announced Friday it would disable its Galaxy Note 7 smartphones in the US market to force remaining owners to stop using the devices, which were recalled for safety reasons.

Swiss unveil stratospheric solar plane

December 7, 2016

Just months after two Swiss pilots completed a historic round-the-world trip in a Sun-powered plane, another Swiss adventurer on Wednesday unveiled a solar plane aimed at reaching the stratosphere.

Solar panels repay their energy 'debt': study

December 6, 2016

The climate-friendly electricity generated by solar panels in the past 40 years has all but cancelled out the polluting energy used to produce them, a study said Tuesday.


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.