Computers will be able to tell social traits from the face

Aug 17, 2011

Researchers have developed new computational tools that help computers determine whether faces fall into categories like attractive or threatening, according to a recent paper published in the journal PLoS ONE. Mario Rojas and other researchers at the Computer Vision Center in the Autonomous University of Barcelona in Spain, in cooperation with researchers from the Department of Psychology of Princeton University, developed software that is able to predict those traits in some cases with accuracies beyond 90%.

Facial characteristics play a central role in our everyday assessments of other people. "The perception of dominance has been shown to be an important part of social roles at different stages of life, and to play a role in mate selection," said Mr. Rojas. If the information on which the evaluation of faces is based could be automatically learned, it could be modeled and used as a tool for designing better interactive systems.

The team studied to what extent this information is learnable from the point of view of computer science. Specifically, the task was formulated with the intention of predicting 9 facial trait judgments (attractive, competent, trustworthy, dominant, mean, frightening, extroverted, threatening, and likable) using Machine learning techniques (a branch of that uses examples to teach a program how to work).

The team trained and tested their algorithm on a set of synthetic generated in a previous study. In that work, people were asked to describe and rate a set of facial images, and these results were used to generate synthetic facial images, each associated with specific traits, such as or dominance.

In the current study, the researchers used a subset of these images, together with their labels, to "teach" the computer how to read a face, and tested the prediction accuracy using the rest of the images. Three traits, dominant, threatening and mean, were found to be predictable with accuracies between 91% and 96%. Additionally the study aimed to find what information is computationally useful for the prediction task. For example, they found that the area around the eyes contains more information about attractiveness, while the area around the mouth is more informative about extroversion.

The researchers also challenged their program's predictive ability against the faces of a number of celebrities; they found that their results are highly consistent with our general ideas about these public figures.

Explore further: Spanish scientists create algorithms to measure sentiment on social networks

More information: Rojas Q. M, Masip D, Todorov A, Vitria J (2011) Automatic Prediction of Facial Trait Judgments: Appearance vs. Structural Models. PLoS ONE 6(8): e23323. doi:10.1371/journal.pone.0023323

Related Stories

New technology to predict future appearance

Mar 11, 2011

A Concordia graduate student has designed a promising computer program that could serve as a new tool in missing-child investigations and matters of national security. Khoa Luu has developed a more effective computer-based ...

A tilt of the head can lure a mate

Nov 22, 2010

(PhysOrg.com) -- The angle we tilt our head can play a significant role in how attractive we are to the opposite sex, according to latest research.

Recommended for you

Congress likely to make key decisions on drones

1 hour ago

The Obama administration is on the verge of proposing long-awaited rules for commercial drone operations in U.S. skies, but key decisions on how much access to grant drones are likely to come from Congress ...

N. Korea suffers another Internet shutdown

Dec 27, 2014

North Korea suffered an Internet shutdown for at least two hours on Saturday, Chinese state-media and cyber experts said, after Pyongyang blamed Washington for an online blackout earlier this week.

User comments : 0

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.