Performance of facial recognition software continues to improve

June 4, 2014 by Evelyn Brown
In NIST's one-to-many tests of facial recognition software, algorithms attempt to match an "unknown" image such as the one on the left to a different image of the same individual (right) in a large collection of 1.6 million "known" images. Credit: NIST

Who is that stranger in your social media photo? A click on the face reveals the name in seconds, almost as soon as you can identify your best friend. While that handy app is not quite ready for your smart phone, researchers are racing to develop reliable methods to match one person's photo from millions of images for a variety of applications. The National Institute of Standards and Technology (NIST) reports that results from its 2013 test of facial recognition algorithms show that accuracy has improved up to 30 percent since 2010.

The report by NIST biometric researchers Patrick Grother and Mei Ngan, Performance of Face identification Algorithms,* includes results from algorithms submitted by 16 organizations. Researchers defined performance by recognition accuracy—how many times the software correctly identified the photo—and the time the algorithms took to match one photo against massive photo data sets.

"We studied the one-to-many identification because it is the largest market for ," Grother said. "These algorithms are used around the world to detect duplicates in databases, fraudulent applications for passports and driving licenses, in token-less access control, surveillance, tagging, lookalike discovery and criminal investigations."

Four research groups enrolled in both the 2013 and the previous 2010 test,** allowing NIST researchers to compare performance improvements over time. They found that those groups had improved their performance on the tests by from 10 and almost 30 percent. One organization decreased its error rate from 8.9 percent in 2010 to 6.4 percent in 2013.

In both years the study used a database of 1.6 million faces. In 2010, the were frontal "mugshot" images from law enforcement agencies that closely comply with the ANSI/NIST ITL 1-2011 Type 10 standard. In 2013, researchers added a small database of images taken for visa applications that meet an ISO/IEC (International Organization for Standardization/International Electrotechnical Commission) standard and 140,000 taken in poorly controlled environments that do not comply with any standard.

The tested algorithms performed the best on the relatively high-quality ISO standardized images collected for passport, visa and driving license applications. Detecting duplicates in those applications is the biggest segment of the marketplace. No algorithms worked well with the webcam images. Search failure rates for those images were around three times greater than for the higher quality images.

The study also shows that rates of missing facial matches increase as the database size increases as expected, but that it does so only slowly. When the number of facial images increased by a factor of 10—from 160,000 to 1.6 million—the error rate only increased by about 1.2 times. This slower-then-expected growth in error rates occurs in many natural phenomenon, and "is largely responsible for the operational utility of face identification algorithms," explains Grother.

Images of older individuals were identified more accurately than those of younger persons, suggesting that we become steadily easier to recognize using , and more distinguishable from our contemporaries, as we age.

Explore further: Iris recognition report evaluates 'needle in haystack' search capability

More information: * P. Grother and M. Ngan. Performance of Face identification Algorithms (NIST Interagency Report 8009). May 2014. Available at

** P. Grother, G.W. Quinn and P.J. Phillips. Report on the Evaluation of 2D Still-Image Face Recognition Algorithms (NIST Interagency Report 7709). August 2011. Available at

Related Stories

Facial-recognition technology proves its mettle

May 24, 2013

( —In a study that evaluated some of the latest in automatic facial recognition technology, researchers at Michigan State University were able to quickly identify one of the Boston Marathon bombing suspects from ...

Recommended for you

WhatsApp vulnerable to snooping: report

January 13, 2017

The Facebook-owned mobile messaging service WhatsApp is vulnerable to interception, the Guardian newspaper reported on Friday, sparking concern over an app advertised as putting an emphasis on privacy.

US gov't accuses Fiat Chrysler of cheating on emissions

January 12, 2017

The U.S. government accused Fiat Chrysler on Thursday of failing to disclose software in some of its pickups and SUVs with diesel engines that allows them to emit more pollution than allowed under the Clean Air Act.

1 comment

Adjust slider to filter visible comments by rank

Display comments: newest first

not rated yet Jun 04, 2014
"Images of older individuals were identified more accurately than those of younger persons, suggesting that we become steadily easier to recognize using facial recognition software, and more distinguishable from our contemporaries, as we age" -- This last sentence is very interesting in spite of been added as a throw away. Is there an evolutionary advantage in been more recognizable as we age--or is it just a byproduct of the changing and reducing fat pads in our faces as they cause our facial features to sink. Come to think of it, why should facial features change with age--often dramatically so in some elder faces. There is a whole world of unasked questions here key to everyone of us--but not funding institutions.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.