Computer algorithm outperforms humans on 'Labeled Faces in the Wild' benchmark

Apr 24, 2014 by Bob Yirka report
Samples of the datasets in the experiments. From left to right: LFW, Multi-PIE, MORPH, Web Images, and Life Photos. Credit: arXiv:1404.3840 [cs.CV]

( —For the first time a computer has beaten the human average when attempting to discriminate between faces in the Labeled Faces in the Wild (LFW) dataset. The team from China that programmed the computer and trained the software has written a paper describing their efforts and achievements and have uploaded it to the arXiv preprint server.

People are better at recognizing faces than computers—everyone knows that. Not so well known is that computers are slowing catching up—the work by a pair of researchers in China, is proof of that. In their paper Chaochao Lu and Xiaoou Tang note that they have fine-tuned an algorithm used for distinguishing between faces in photographs, but note that the real breakthrough came in the training. In order for a to figure out if the people shown in two different photographs are the same person, the computer has to have a much broader dataset to draw on.

People get better at recognizing faces the more often they see them—scientists aren't sure why this is exactly, but it clearly has something to do with adding more data as a person is seen from more angles, in different light, using different expressions, while wearing makeup or not, etc. The same thing is true for a computer. In order to discern if two photos show the same person, the computer has to have seen that person before in multiple environments—to allow that to happen, the researchers exposed their system (using the Discriminative Gaussian Process Latent Variable Model), which they call GaussianFace, to multiple datasets, such as the Multi-PIE database or Life Photos. Both offer multiple pictures of the same person to allow for not just better comparison capabilities for those in those datasets, but for getting smarter in general regarding how to match in other datasets.

The approach used by the research duo obviously worked as they report a success rate of 98.52 percent on the LFW, compared to an average of 97.53 percent for humans—the first time a computer has ever beaten the human average. The LFW is a database with a of 13,000 headshots of famous people and has become a standard benchmark for testing facial recognition using a computer. Beating humans on the LFW is a truly remarkable achievement, of course, but, as the researchers note, it is just one benchmark. Computer technology still has a long way to go before matching the abilities of humans in generalized surroundings.

Explore further: See what a child will look like using automated age-progression software (w/ video)

More information: Surpassing Human-Level Face Verification Performance on LFW with GaussianFace, arXiv:1404.3840 [cs.CV]

Face verification remains a challenging problem in very complex conditions with large variations such as pose, illumination, expression, and occlusions. This problem is exacerbated when we rely unrealistically on a single training data source, which is often insufficient to cover the intrinsically complex face variations. This paper proposes a principled multi-task learning approach based on Discriminative Gaussian Process Latent Variable Model, named GaussianFace, to enrich the diversity of training data. In comparison to existing methods, our model exploits additional data from multiple source-domains to improve the generalization performance of face verification in an unknown target-domain. Importantly, our model can adapt automatically to complex data distributions, and therefore can well capture complex face variations inherent in multiple sources. Extensive experiments demonstrate the effectiveness of the proposed model in learning from diverse data sources and generalize to unseen domain. Specifically, the accuracy of our algorithm achieves an impressive accuracy rate of 98.52% on the well-known and challenging Labeled Faces in the Wild (LFW) benchmark. For the first time, the human-level performance in face verification (97.53%) on LFW is surpassed.

Related Stories

Dogs recognize familiar faces from images

Dec 18, 2013

So far the specialized skill for recognizing facial features holistically has been assumed to be a quality that only humans and possibly primates possess. Although it's well known, that faces and eye contact ...

The fundamental mechanisms of facial recognition

Mar 24, 2014

When it comes to recognizing faces, humans are extraordinarily skillful. It's no surprise – after all, from the moment humans leave the womb, the infant brains already have a preference for faces, and over ...

Face it: Instagram pictures with faces are more popular

Mar 20, 2014

Like them or not, there's more proof that selfies aren't going away any time soon. Georgia Institute of Technology and Yahoo Labs researchers looked at 1.1 million photos on Instagram and found that pictures ...

Identifying people by their bodies when faces are no help

Oct 03, 2013

Every day we recognize friends, family, and co-workers from afar—even before we can distinctly see a face. New research reveals that when facial features are difficult to make out, we readily use information ...

Recommended for you

Cooperative software framework helps tame "too big" data

Mar 23, 2015

Furthering work involving the Graph Engine for Multithreaded Systems, or GEMS, a multilayer software framework for querying graph databases developed at Pacific Northwest National Laboratory, scientists from ...

User comments : 3

Adjust slider to filter visible comments by rank

Display comments: newest first

5 / 5 (1) Apr 24, 2014
"People are better at recognizing faces than computers."
Indeed, some people cannot recognize computers at all. Perhaps the sentence intended was: "People are better than computers at recognizing faces." ;)
not rated yet Apr 24, 2014
So a machine made within a few decades outperforms a Homo Sapiens?

Take that, evolution.
not rated yet Apr 27, 2014
So a machine made within a few decades outperforms a Homo Sapiens?

Take that, evolution.

Sorry, it's still evolution.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.