Computers will be able to tell social traits from the face

Aug 17, 2011

Researchers have developed new computational tools that help computers determine whether faces fall into categories like attractive or threatening, according to a recent paper published in the journal PLoS ONE. Mario Rojas and other researchers at the Computer Vision Center in the Autonomous University of Barcelona in Spain, in cooperation with researchers from the Department of Psychology of Princeton University, developed software that is able to predict those traits in some cases with accuracies beyond 90%.

Facial characteristics play a central role in our everyday assessments of other people. "The perception of dominance has been shown to be an important part of social roles at different stages of life, and to play a role in mate selection," said Mr. Rojas. If the information on which the evaluation of faces is based could be automatically learned, it could be modeled and used as a tool for designing better interactive systems.

The team studied to what extent this information is learnable from the point of view of computer science. Specifically, the task was formulated with the intention of predicting 9 facial trait judgments (attractive, competent, trustworthy, dominant, mean, frightening, extroverted, threatening, and likable) using Machine learning techniques (a branch of that uses examples to teach a program how to work).

The team trained and tested their algorithm on a set of synthetic generated in a previous study. In that work, people were asked to describe and rate a set of facial images, and these results were used to generate synthetic facial images, each associated with specific traits, such as or dominance.

In the current study, the researchers used a subset of these images, together with their labels, to "teach" the computer how to read a face, and tested the prediction accuracy using the rest of the images. Three traits, dominant, threatening and mean, were found to be predictable with accuracies between 91% and 96%. Additionally the study aimed to find what information is computationally useful for the prediction task. For example, they found that the area around the eyes contains more information about attractiveness, while the area around the mouth is more informative about extroversion.

The researchers also challenged their program's predictive ability against the faces of a number of celebrities; they found that their results are highly consistent with our general ideas about these public figures.

Explore further: Ant colonies help evacuees in disaster zones

More information: Rojas Q. M, Masip D, Todorov A, Vitria J (2011) Automatic Prediction of Facial Trait Judgments: Appearance vs. Structural Models. PLoS ONE 6(8): e23323. doi:10.1371/journal.pone.0023323

Related Stories

New technology to predict future appearance

Mar 11, 2011

A Concordia graduate student has designed a promising computer program that could serve as a new tool in missing-child investigations and matters of national security. Khoa Luu has developed a more effective computer-based ...

A tilt of the head can lure a mate

Nov 22, 2010

(PhysOrg.com) -- The angle we tilt our head can play a significant role in how attractive we are to the opposite sex, according to latest research.

Recommended for you

Quantenna promises 10-gigabit Wi-Fi by next year

4 hours ago

(Phys.org) —Quantenna Communications has announced that it has plans for releasing a chipset that will be capable of delivering 10Gbps WiFi to/from routers, bridges and computers by sometime next year. ...

New US-Spanish firm says targets rich mobile ad market

5 hours ago

Spanish telecoms firm Telefonica and US investment giant Blackstone launched a mobile telephone advertising venture on Wednesday, challenging internet giants such as Google and Facebook in a multi-billion-dollar ...

Environmentally compatible organic solar cells

5 hours ago

Environmentally compatible production methods for organic solar cells from novel materials are in the focus of "MatHero". The new project coordinated by Karlsruhe Institute of Technology (KIT) aims at making ...

Twitter rules out Turkey office amid tax row

5 hours ago

Social networking company Twitter on Wednesday rejected demands from the Turkish government to open an office there, following accusations of tax evasion and a two-week ban on the service.

User comments : 0

More news stories

Quantenna promises 10-gigabit Wi-Fi by next year

(Phys.org) —Quantenna Communications has announced that it has plans for releasing a chipset that will be capable of delivering 10Gbps WiFi to/from routers, bridges and computers by sometime next year. ...

Floating nuclear plants could ride out tsunamis

When an earthquake and tsunami struck the Fukushima Daiichi nuclear plant complex in 2011, neither the quake nor the inundation caused the ensuing contamination. Rather, it was the aftereffects—specifically, ...

Unlocking secrets of new solar material

(Phys.org) —A new solar material that has the same crystal structure as a mineral first found in the Ural Mountains in 1839 is shooting up the efficiency charts faster than almost anything researchers have ...

Patent talk: Google sharpens contact lens vision

(Phys.org) —A report from Patent Bolt brings us one step closer to what Google may have in mind in developing smart contact lenses. According to the discussion Google is interested in the concept of contact ...

How kids' brain structures grow as memory develops

Our ability to store memories improves during childhood, associated with structural changes in the hippocampus and its connections with prefrontal and parietal cortices. New research from UC Davis is exploring ...

Gate for bacterial toxins found

Prof. Dr. Dr. Klaus Aktories and Dr. Panagiotis Papatheodorou from the Institute of Experimental and Clinical Pharmacology and Toxicology of the University of Freiburg have discovered the receptor responsible ...