Notre Dame computer vision experts develop 'questionable observer detector'

Oct 11, 2011

It's become a standard plot device of television detective shows: criminals always return to the scene of the crime. And law enforcement officials believe that perpetrators of certain crimes, mostly notably arson, do indeed have an inclination to witness their handiwork. Also, U.S. military in the Middle East feel that IED bomb makers return to see the results of their work in order to evolve their designs.

Now a team of University of Notre Dame biometrics experts are developing a crime-fighting tool that can help identify suspicious individuals at .

Kevin Bowyer and Patrick Flynn of Notre Dame's Computer Science and Engineering Department have been researching the feasibility of image-based biometrics since 2001, including first-of-their-kind comparisons of face photographs, face thermograms, 3-D , iris images, videos of human gait, and even ear and hand shapes.

While attending a meeting in Washington, D.C, Bowyer listened as military and national security experts discussed the need for a tool to help identify IED bombers in the Middle East.

He decided to join forces with Flynn and Jeremiah Barr, a doctoral student in computer science and engineering, to tackle the challenge he heard expressed at the Washington meeting. The researchers developed a "Questionable Observer Detector (QuOD)" to identify individuals who repeatedly appear in video taken of bystanders at crime scenes.

The challenge was especially daunting because the researchers lacked a data base to compare faces against. Also, many times crime scene videos are shot by witnesses using handheld videos and are often of poor quality. Additionally, many criminals try to disguise their appearance in various ways.

In response, the Notre Dame team focused on an automatic facial recognition tool that didn't need to match people against an existing database of known identities. Instead, Bowyer, Flynn and Barr create "face tracks" for all individuals appearing in a video and repeat the process for all available video clips. The face tracks are compared to determine if any faces from different video clips look similar enough to match each other. When the technology spots a match, it adds it to a group of video appearances featuring just that person. In this way, it attempts to cluster together the pieces of different video clips that represent the same person.

An individual is considered suspicious if he or she appears too frequently in the set of videos. The "too many" number is determined by law enforcement officials based on the number of crimes and videos available.

Although the technology shows great promise, Bowyer, Flynn and Barr admit they still have serious technical challenges they are working to overcome. Optimum technology requires high quality lighting and video resolution, which is often unavailable at crime scenes. Also, people may not be looking directly at the camera in video of crowds of . And the identification of a questionable observer becomes more computationally demanding in cases where there a large number of videos to be analyzed.

The researchers are confident, however, that these challenges can be overcome and are continuing to work to improve their system. They are also confident that civil liberties concerns are minimized and positive social benefit is invovled, given that the tool helps officials identify individuals by their actual presence at multiple crime scenes rather than by suspicion.

Explore further: Forging a photo is easy, but how do you spot a fake?

add to favorites email to friend print save as pdf

Related Stories

YouTube adds online video editing tool

Jun 17, 2010

YouTube users can now edit their own videos online. The Google-owned video-sharing site added an online editing tool this week that allows YouTube users to combine multiple videos, shorten a video or add soundtracks ...

Improving security with face recognition technology

Nov 10, 2009

A number of U.S. states now use facial recognition technology when issuing drivers licenses. Similar methods are also used to grant access to buildings and to verify the identities of international travelers. ...

Recommended for you

Forging a photo is easy, but how do you spot a fake?

Nov 21, 2014

Faking photographs is not a new phenomenon. The Cottingley Fairies seemed convincing to some in 1917, just as the images recently broadcast on Russian television, purporting to be satellite images showin ...

Algorithm, not live committee, performs author ranking

Nov 21, 2014

Thousands of authors' works enter the public domain each year, but only a small number of them end up being widely available. So how to choose the ones taking center-stage? And how well can a machine-learning ...

Professor proposes alternative to 'Turing Test'

Nov 19, 2014

(Phys.org) —A Georgia Tech professor is offering an alternative to the celebrated "Turing Test" to determine whether a machine or computer program exhibits human-level intelligence. The Turing Test - originally ...

Image descriptions from computers show gains

Nov 18, 2014

"Man in black shirt is playing guitar." "Man in blue wetsuit is surfing on wave." "Black and white dog jumps over bar." The picture captions were not written by humans but through software capable of accurately ...

Converting data into knowledge

Nov 17, 2014

When a movie-streaming service recommends a new film you might like, sometimes that recommendation becomes a new favorite; other times, the computer's suggestion really misses the mark. Yisong Yue, assistant ...

User comments : 0

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.