DARPA advances video analysis tools

June 24, 2011, DARPA

A massive amount of data from video sensors is collected in theater, and there aren’t enough analysts or time available to review. Reducing the amount of data or the number of sensors isn’t the answer, and there will never be enough analysts. The solution lies in better automated capabilities that can identify areas and activities that require human analyst attention.

DARPA’s Video and Image Retrieval and Analysis Tool (VIRAT) and Persistent Stare Exploitation and Analysis System (PerSEAS) programs may soon enable better warfighter analysis of huge amounts of data generated from multiple types of sensors. “Bad guys do bad things, such as all the actions involved in burying an IED – so it is activity that matters. This is especially true when bad guys look, dress, and drive vehicles like those around them,” said Mita Desai, program manager for VIRAT and PerSEAS. “The analysis tools to find these activities and the underlying actions just don’t exist, which is why there is such interest in activity-based analysis and exploitation.”

Text searching and algorithms for facial and other object recognition already exist. Up to now, finding actions of interest within previously untagged, raw video has been a resource drain and such a technical challenge as to seem ‘impossible’. Desai explained, “The objectives of VIRAT and PerSEAS are NOT to replace human analysts, but to make them more effective and efficient by reducing their cognitive load and enabling them to search for activities and threats quickly and easily.”

DARPA Video and Image Retrieval and Analysis Tool (VIRAT)

With VIRAT’s ability to identify and highlight key actions and PerSEAS’s ability to ‘see’ dangerous combinations of actions as activities, analysts will soon be able to concentrate on more detailed reviews and understanding of the data.

The initial prototype of VIRAT works in both forensic mode (finding activities in thousands of hours of archived, untagged data) and streaming mode (highlighting actions as the video download is being viewed). Additional research and development work is underway for PerSEAS prior to deployment for field testing.

VIRAT is focused on full-motion video, from platforms such as Predator or Aerostats, allowing analysts to either monitor the live downlink for specific actions of interest or search an existing archive for past occurrences. There searches are conducted using a video clip as the input query. VIRAT finds actions that are short in duration and occur in small geographic areas. PerSEAS focuses on wide-area coverage, such as data from Constant Hawk, Gorgon Stare, ARGUS-IS and other persistent sensors. PerSEAS observes multiple actions over a long duration and large geographic regions to postulate complex threat activities. Algorithms from VIRAT provide some of the underlying capabilities within PerSEAS.

Explore further: Home-computer users at risk due to use of 'folk model' security

Related Stories

Modern society made up of all types

November 4, 2010

Modern society has an intense interest in classifying people into ‘types’, according to a University of Melbourne Cultural Historian, leading to potentially catastrophic life-changing outcomes for those typed – ...

'Robin Hoods of the digital age’

December 8, 2010

Many illegal file sharers believe they are the 'Robin Hoods of the digital age' and are motivated by altruism and a desire for notoriety, according to new research which analyses why people illegally download digital media.

Robot, object, action!

October 29, 2010

Robotic demonstrators developed by European researchers produce compelling evidence that ‘thinking-by-doing’ is the machine cognition paradigm of the future. Robots act on objects and teach themselves in the process.

Recommended for you

Top takeaways from Consumers Electronics Show

January 13, 2018

The 2018 Consumer Electronics Show, which concluded Friday in Las Vegas, drew some 4,000 exhibitors from dozens of countries and more than 170,000 attendees, showcased some of the latest from the technology world.

Finnish firm detects new Intel security flaw

January 12, 2018

A new security flaw has been found in Intel hardware which could enable hackers to access corporate laptops remotely, Finnish cybersecurity specialist F-Secure said on Friday.

1 comment

Adjust slider to filter visible comments by rank

Display comments: newest first

not rated yet Jun 27, 2011
I suppose burying an ied is one, carrying a rifle is another, laying on the ground and looking through binoculars is another, peeking around buildings and scurrying to the next concealment is another....sounds like this technology could be expansive and quite impressive.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.