Computer algorithm outperforms humans on 'Labeled Faces in the Wild' benchmark

April 24, 2014 by Bob Yirka report
Samples of the datasets in the experiments. From left to right: LFW, Multi-PIE, MORPH, Web Images, and Life Photos. Credit: arXiv:1404.3840 [cs.CV]

(Phys.org) —For the first time a computer has beaten the human average when attempting to discriminate between faces in the Labeled Faces in the Wild (LFW) dataset. The team from China that programmed the computer and trained the software has written a paper describing their efforts and achievements and have uploaded it to the arXiv preprint server.

People are better at recognizing faces than computers—everyone knows that. Not so well known is that computers are slowing catching up—the work by a pair of researchers in China, is proof of that. In their paper Chaochao Lu and Xiaoou Tang note that they have fine-tuned an algorithm used for distinguishing between faces in photographs, but note that the real breakthrough came in the training. In order for a to figure out if the people shown in two different photographs are the same person, the computer has to have a much broader dataset to draw on.

People get better at recognizing faces the more often they see them—scientists aren't sure why this is exactly, but it clearly has something to do with adding more data as a person is seen from more angles, in different light, using different expressions, while wearing makeup or not, etc. The same thing is true for a computer. In order to discern if two photos show the same person, the computer has to have seen that person before in multiple environments—to allow that to happen, the researchers exposed their system (using the Discriminative Gaussian Process Latent Variable Model), which they call GaussianFace, to multiple datasets, such as the Multi-PIE database or Life Photos. Both offer multiple pictures of the same person to allow for not just better comparison capabilities for those in those datasets, but for getting smarter in general regarding how to match in other datasets.

The approach used by the research duo obviously worked as they report a success rate of 98.52 percent on the LFW, compared to an average of 97.53 percent for humans—the first time a computer has ever beaten the human average. The LFW is a database with a of 13,000 headshots of famous people and has become a standard benchmark for testing facial recognition using a computer. Beating humans on the LFW is a truly remarkable achievement, of course, but, as the researchers note, it is just one benchmark. Computer technology still has a long way to go before matching the abilities of humans in generalized surroundings.

Explore further: Dogs recognize familiar faces from images

More information: Surpassing Human-Level Face Verification Performance on LFW with GaussianFace, arXiv:1404.3840 [cs.CV] arxiv.org/abs/1404.3840

Abstract
Face verification remains a challenging problem in very complex conditions with large variations such as pose, illumination, expression, and occlusions. This problem is exacerbated when we rely unrealistically on a single training data source, which is often insufficient to cover the intrinsically complex face variations. This paper proposes a principled multi-task learning approach based on Discriminative Gaussian Process Latent Variable Model, named GaussianFace, to enrich the diversity of training data. In comparison to existing methods, our model exploits additional data from multiple source-domains to improve the generalization performance of face verification in an unknown target-domain. Importantly, our model can adapt automatically to complex data distributions, and therefore can well capture complex face variations inherent in multiple sources. Extensive experiments demonstrate the effectiveness of the proposed model in learning from diverse data sources and generalize to unseen domain. Specifically, the accuracy of our algorithm achieves an impressive accuracy rate of 98.52% on the well-known and challenging Labeled Faces in the Wild (LFW) benchmark. For the first time, the human-level performance in face verification (97.53%) on LFW is surpassed.

Related Stories

Dogs recognize familiar faces from images

December 18, 2013

So far the specialized skill for recognizing facial features holistically has been assumed to be a quality that only humans and possibly primates possess. Although it's well known, that faces and eye contact play an important ...

Face it: Instagram pictures with faces are more popular

March 20, 2014

Like them or not, there's more proof that selfies aren't going away any time soon. Georgia Institute of Technology and Yahoo Labs researchers looked at 1.1 million photos on Instagram and found that pictures with human faces ...

Recommended for you

Customizing 3-D printing

September 3, 2015

The technology behind 3-D printing is growing more and more common, but the ability to create designs for it is not. Any but the simplest designs require expertise with computer-aided design (CAD) applications, and even for ...

Team develops targeted drug delivery to lung

September 2, 2015

Researchers from Columbia Engineering and Columbia University Medical Center (CUMC) have developed a new method that can target delivery of very small volumes of drugs into the lung. Their approach, in which micro-liters ...

Magnetic fields provide a new way to communicate wirelessly

September 1, 2015

Electrical engineers at the University of California, San Diego demonstrated a new wireless communication technique that works by sending magnetic signals through the human body. The new technology could offer a lower power ...

3 comments

Adjust slider to filter visible comments by rank

Display comments: newest first

tadchem
5 / 5 (1) Apr 24, 2014
"People are better at recognizing faces than computers."
Indeed, some people cannot recognize computers at all. Perhaps the sentence intended was: "People are better than computers at recognizing faces." ;)
JesusDeNazareth
not rated yet Apr 24, 2014
So a machine made within a few decades outperforms a Homo Sapiens?

Take that, evolution.
alfie_null
not rated yet Apr 27, 2014
So a machine made within a few decades outperforms a Homo Sapiens?

Take that, evolution.

Sorry, it's still evolution.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.