How Does the Brain Recognize a Face?

November 13, 2007

The smile of the Mona Lisa may remain forever ineffable, but at least now science can measure the difference between the real thing and its many imitations.

A team of neuroscientists including Irving Biederman, the holder of the Harold Dornsife Chair in Neurosciences in USC College, say they can predict with near-perfect accuracy whether two faces resemble each other enough to fool a human observer.

Their study provides rare insight into the hard rules guiding one of the most subjective of processes.

The researchers presented their results Nov. 6 in San Diego, at the annual meeting of the Society for Neuroscience.

The study used a face recognition computer model, previously developed by Christoph von der Malsburg of the USC Viterbi School of Engineering and the College, to try to understand how human brains recognize faces.

“We knew that the model could do a good job at matching one image of a face to a different picture of the same person,” Biederman said, “but we did not know whether it was doing it in a manner that mimicked the way people were doing it.

“Our experiments showed that if the model computes two faces to be very similar, then people will have a hard time telling the difference between the two faces.”

The research group, which included lead researcher Xiaomin Yue, a 2007 alumnus of the College’s psychology doctoral program who is now a research fellow at Massachusetts General Hospital, interpreted the consistent results as evidence that the computer model faithfully represents neural processes.

“It’s quite likely, or at least plausible, that the brain is doing face matching this way,” said Biederman, professor of psychology and computer science.

To test the model, the researchers showed a dozen volunteers a triangular array of three faces for a half a second. One of the lower faces was an identical match to the upper face, while the similarity of the nonmatching face, as measured by the model, varied slightly.

Biederman said the model “predicted almost perfectly” which faces would stump the study subjects, leading them to make slow and incorrect decisions.

“All subjects showed exactly the same pattern,” he said.

The model builds on previous studies of the first area in the visual cortex to receive signals from the optic nerve. Known as V1, the area contains hundreds of millions of neurons tuned to detect contrast between light and dark.

Each neuron fires only when its simple preferred feature — say a white bar on a black background — appears in a unique location, at a unique angle and at a unique size. This pattern of neuronal firing then drives networks of neurons in later stages that represent faces, objects and scenes.

These later networks allow the brain to recognize objects even if they appear in a different orientation or with a different direction of illumination.

This ability comes at the expense of some of the data acquired by V1, including details useful in facial recognition, Biederman said.

For that task, which demands very fine discrimination, Biederman and others believe that the brain reverts to a V1-type of image analysis, though at a risk of error if the viewing conditions change.

For example, humans find it almost impossible to recognize a face if it is upside down, or lit from an unfamiliar angle, or viewed as a photographic negative. Not so with objects.

Biederman said the study also helps explain why many beginning artists struggle to represent objects believably.

“The hard part about learning to draw is not drawing the object,” Biederman said, meaning that the artist must focus on V1-acquired properties, such as reflectance, orientation and graininess, that the brain automatically subordinates.

Biederman, who has explored aesthetic theory with his research on visual perception, will investigate the conservation of aesthetic principles in ancient cave art and in remote tribes in two upcoming papers.

Source: USC College

Explore further: 'Thirst for knowledge' may be opium craving

Related Stories

'Thirst for knowledge' may be opium craving

June 20, 2006

Neuroscientists have proposed a simple explanation for the pleasure of grasping a new concept: The brain is getting its fix. The "click" of comprehension triggers a biochemical cascade that rewards the brain with a shot of ...

The role of genetic factors in adult ADHD

September 15, 2009

Attention deficit/hyperactivity disorder, ADHD, is one of the most common neuropsychiatric disorders of childhood. Worldwide, 3󈝸% of children are affected with the disorder. Key symptoms of ADHD include age-inappropriate ...

Recommended for you

How the finch changes its tune

August 3, 2015

Like top musicians, songbirds train from a young age to weed out errors and trim variability from their songs, ultimately becoming consistent and reliable performers. But as with human musicians, even the best are not machines. ...

Cow embryos reveal new type of chromosome chimera

May 27, 2016

I've often wondered what happens between the time an egg is fertilized and the time the ball of cells that it becomes nestles into the uterine lining. It's a period that we know very little about, a black box of developmental ...

Shaving time to test antidotes for nerve agents

February 29, 2016

Imagine you wanted to know how much energy it took to bike up a mountain, but couldn't finish the ride to the peak yourself. So, to get the total energy required, you and a team of friends strap energy meters to your bikes ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.