Video analysis software becomes more usable for police

April 22, 2013 by Steve Johnson

As police increasingly sort through video surveillance tapes in their hunt for criminals, as happened in the search for the Boston Marathon bombers, some are turning to face-recognition and data-analysis software to help make sense of the images.

The products promise to one day revolutionize crime fighting. Although experts say won't fully embrace the software until it becomes more sophisticated, they also say that day is not far away.

"I believe more and more will adopt this technology," said Anil Jain, a Michigan State University computer scientist and engineering professor who is researching the subject. "I would say in five years we should have significant gains in automatic face recognition in video."

One company whose face-recognition system already is being used by police is 3VR of San Francisco. In Elk Grove, Calif., for example, officers can use it to analyze images fed to them in real time from around the city, said CEO Al Shipp. Besides letting them search the data for suspects, he said, it can issue alerts when the cameras spot people the police are hunting.

"It's kind of like having a policeman on every corner," he said. Although he noted the technology is still evolving, he believes it will catch on with , especially in "places like Boston and New York that have had terrorist events. I think the high-density urban areas will probably be the lead in the thing."

Hewlett-Packard's information-crunching Autonomy software also is being used by some police to analyze . In addition, Apple recently won a face-recognition patent, and Intel officials have said they are working on the technology.

So far, law-enforcement adoption of the concept remains spotty.

"It's definitely not something we use now," said San Jose Police Department spokesman Albert Morales.

Neither do San Francisco Police, according to their spokesman, Sgt. Dennis Toomer, although he added, "It would be nice. We'd love to have it."

But the FBI is expected to create a face-recognition system next year for members of the Western Identification Network, a consortium of police agencies in California and eight other Western states, according to the network's CEO, Ken Bischoff.

Noting that the system will involve a photo database of people who have been arrested, Bischoff cautioned that "facial recognition at this state in the game is much less accurate than fingerprint biometrics or DNA biometrics. It's a useful investigative tool, but it's not lights-out yet."

Computer expert Jain agreed, adding that "the quality of images acquired from these networked cameras need to be continually improved to allow for more accurate face recognition."

One big problem, he said, is that photos police get from street-level video systems or witnesses' smartphone cameras often only show part of a suspect's face, making it hard to match the image with photos from passports, drivers licenses and other publicly available sources.

"Typically, we need to locate a couple of points of reference on the face to 'align' face images for comparison," he said. "Normally, the two eye locations are used for this comparison." But, he added, "if the eyes are not visible in the video frame of the suspect, then the matching problem becomes difficult."

Because of that, Jain said he is studying ways to use multiple partial images of a suspect to create a three-dimensional portrait, which may provide clearer clues to their identity. Shipp said 3VR is also working with 3-D.

Cindy Cohn, legal director of the Electronic Frontier Foundation, a San Francisco-based public interest group, agreed that the technology "will get better over time," which should ease her group's concern that such systems might misidentify innocent people as suspects.

But even if the technology is improved, she said, another worry is that police might build massive visual databases that could impinge on people's privacy. While the police should be applauded for using video images to track down dangerous criminals, she said, "this should not be an open door to let law enforcement into your personal life."

Explore further: Facial recognition in use after riots


Related Stories

Facial recognition in use after riots

August 11, 2011

(AP) -- Facial recognition technology being considered for London's 2012 Games is getting a workout in the wake of Britain's riots, a law enforcement official told The Associated Press on Thursday, with officers feeding photographs ...

Method developed to match police sketch, mug shot

March 3, 2011

( -- The long-time practice of using police facial sketches to nab criminals has been, at best, an inexact art. But the process may soon be a little more exact thanks to the work of some Michigan State University ...

New York police launch high-tech surveillance

August 8, 2012

New York police on Wednesday launched what officials say is a revolutionary camera surveillance system that will simultaneously scan the streets and call up data on suspects.

Instant facial recognition a two-edged sword

November 21, 2012

By the time Joe Rosenkrantz took his seat in his company's conference room, a video camera had already handled the introductions. An image of Rosenkrantz, taken as he walked toward his chair, instantly popped up on a nearby ...

Recommended for you

Permanent, wireless self-charging system using NIR band

October 8, 2018

As wearable devices are emerging, there are numerous studies on wireless charging systems. Here, a KAIST research team has developed a permanent, wireless self-charging platform for low-power wearable electronics by converting ...

Facebook launches AI video-calling device 'Portal'

October 8, 2018

Facebook on Monday launched a range of AI-powered video-calling devices, a strategic revolution for the social network giant which is aiming for a slice of the smart speaker market that is currently dominated by Amazon and ...

Artificial enzymes convert solar energy into hydrogen gas

October 4, 2018

In a new scientific article, researchers at Uppsala University describe how, using a completely new method, they have synthesised an artificial enzyme that functions in the metabolism of living cells. These enzymes can utilize ...


Adjust slider to filter visible comments by rank

Display comments: newest first

1 / 5 (1) Apr 22, 2013
So who is going to do the surveillance on the police ?
1 / 5 (1) Apr 22, 2013
So who is going to do the surveillance on the police ?
The same people who planned 9/11
not rated yet Apr 22, 2013
The same people who planned 9/11

Al-qeida? They are too busy planning funerals for their martyrs these days.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.