Smart search engines for news videos

January 7, 2013
NewsHistory makes the most of user knowledge, searching through video databases to find video sequences with identical content. Credit: Fraunhofer IDMT

Searching for video recordings regularly pushes search engines to their limit. The truth of the matter is that purely automatic algorithms are not enough; user knowledge has to be harnessed, too. Now, researchers are making automated engines smarter.

Anyone who has visited one of the big online or TV broadcasters' media libraries to search for a video clip is already familiar with the search engines tasked with seeking out and flagging . However, these engines have their weaknesses. Their results are based on automatic search algorithms that often go by text-based information alone. Although they can be used to locate and identify videos, a comparison of individual is still very difficult. To make search engines even smarter, the Fraunhofer Institute for IDMT in Ilmenau has developed a piece of software called "NewsHistory" that will now make full use of user knowledge as well. Researchers will be presenting an initial demonstration version of the smart at the trade fair in Hannover from March 5-9, 2013 (Hall 9, Booth E08).

Technology learns from users

"NewsHistory provides users with search algorithms, a data model and a web-based user interface so that they can locate identical sequences within various news videos," explains Patrick Aichroth from Fraunhofer IDMT. He is responsible for coordinating the institute's R&D work within the EU's CUbRIK project. Here, researchers are harnessing user knowledge to optimize and extend the capabilities of automated analysis techniques. "The search engine learns from each individual user, allowing it to keep im-
proving search results. Not only does this improve the quality of results, but the re-
sources needed to undertake the analysis are also cut down," Aichroth continues.

NewsHistory allows each user to add additional information to the results generated by the search engine, including production and broadcast date, sources and keywords for videos. It is also possible to rate the results. Finally, the user's search itself is a source of information, providing data that is incorporated into the search engine; the metadata of a newly uploaded video, for instance, passes into the database.

"Comparing digital video data online or within video databases is very complex," explains Christian Weigel from the Audio-Visual Systems research group at the IDMT. "Videos that share the same content have for the most part been edited, meaning that they are scaled and encoded in a variety of formats. Also, search engines are often unable to distinguish images cropped from a larger picture, lower thirds or the zoom shots so popular with US news channels."

The demonstration version being presented at CeBIT will investigate how a selection of TV channels have made use of film footage, changed its form and broadcast it. The user interface displays commonalities and appraises them in graphic form. The itself is conducted either by inputting text or by directly uploading individual video se-
quences. The researchers' aim is to make the software sufficiently robust that it could also be used in the future to compare the multimedia content found on big online media portals. The scientists do not imagine archivists or journalists will be the only users. "NewsHistory is of particular interest to media and market researchers, say if they want to assess the televised political duels coming up this year," concludes Weigel.

Explore further: Search engine mashup

Related Stories

Search engine mashup

July 6, 2007

A mashup of two different types of web search tools could make find the useful nuggets of information among all the grit on the Internet much easier.

Search engine branding to be examined by researcher

June 11, 2008

Like other industries, companies that maintain search engines must work harder to recruit and retain customers. One way to do this is branding -- creating a cognitive impression that a user is likely to retain and rely on ...

VuNow Sends Free Internet Video Directly to Your TV

December 31, 2008

Verismo's VuNow is an affordable solution for video lovers that sends free internet video content directly to your Television set. VuNow only takes a minute to connect, just plug in the AC power, connect your A/V or HDMI ...

Multimedia search without detours

April 2, 2010

Finding a particular song or video is often no easy matter. Manually assigned metadata may be incorrect, and the unpacking of compressed data can slow up the search. DIVAS, a multimedia search engine, uses digital fingerprints ...

iSchool prof predicts the future of search user interfaces

November 7, 2011

School of Information professor Marti Hearst predicts the future of online search interfaces in an article in this month’s edition of the Communications of the ACM. “The future of user interfaces will involve ...

Recommended for you

World is embracing clean energy, professor says

February 1, 2016

Renewable, energy efficient and flexible electricity sources are being adopted by policy makers and investors across the globe and this is sign of optimism in the battle against climate change, a University of Exeter energy ...

Battery technology could charge up water desalination

February 4, 2016

The technology that charges batteries for electronic devices could provide fresh water from salty seas, says a new study by University of Illinois engineers. Electricity running through a salt water-filled battery draws the ...

Researchers find vulnerability in two-factor authentication

February 3, 2016

Two-factor authentication is a computer security measure used by major online service providers to protect the identify of users in the event of a password loss. The process is familiar: When a password is forgotten, the ...

World's first 'robot run' farm to open in Japan

February 1, 2016

A Japanese firm said Monday it would open the world's first fully automated farm with robots handling almost every step of the process, from watering seedlings to harvesting crops.


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.