Happy, sad, angry or astonished?

July 3, 2007
Happy, sad, angry or astonished?
A new image analysis software can immediately identify whether the person in the image is male or female and what kind of mood they are in. © Fraunhofer IIS

How do people respond when they walk past an advertising poster? Do they stop and turn around to look at it with interest or march angrily past? A new system of detailed facial analysis can recognize a person’s mood in an instant.

An advertisement for a new perfume is hanging in the departure lounge of an airport. Thousands of people walk past it every day. Some stop and stare in astonishment, others walk by, clearly amused. And then there are those who seem puzzled when they look at the poster.

With the help of a small video camera, the system automatically localizes the faces of everyone who walks past the advertisement. And nothing escapes its watchful eye: Does the passerby look happy, surprised, sad or even angry?

The system for rapid facial analysis is being developed by researchers at the Fraunhofer Institute for Integrated Circuits IIS in Erlangen. Highly complex algorithms immediately localize human faces in the image, differentiate between men and women and analyze their expressions.

“The special feature of our facial analysis software is that it operates in real time,” says Dr. Christian Küblbeck, project manager at the IIS. “What’s more, it is able to localize and analyze a large number of faces simultaneously.” The most important facial characteristics used by the system are the contours of the face, the eyes, the eyebrows and the nose. First of all, the system has to go through a training phase in which it is presented with huge quantities of data containing images of faces. In normal operation, the computer compares 30,000 facial characteristics with the information that it has previously learned.

“On a standard PC, the calculations are carried out so quickly that mood changes can be tracked live,” explains Küblbeck. However, we do not need to worry about an invasion of our privacy, as the software analyzes the data on a purely statistical basis.

The software package is not only of interest to advertising psychologists; there are numerous potential applications for the system. It can be used, for example, to test the user-friendliness of computer software programs. The system monitors the facial expressions of the user in order to determine which aspects of the program arouse a particularly strong reaction. Alternatively, it can assess the reactions of the users of learning software, in order to establish the extent to which they are put under stress or challenged by the task they are performing. The system could also be used to check the levels of concentration of car drivers.

A demonstration version of the face detection and analysis software package is available for download at: www.iis.fraunhofer.de/EN/bf/bv/kognitiv/biom/dd.jsp

Source: Fraunhofer-Gesellschaft

Explore further: Scientists adapt computer program to gauge eye spasm severity

Related Stories

Emotion-tracking software aims for "mood-aware" internet

July 31, 2014

Emotions can be powerful for individuals. But they're also powerful tools for content creators, such as advertisers, marketers, and filmmakers. By tracking people's negative or positive feelings toward ads—via traditional ...

Cut-and-paste simplicity for computer animation

July 27, 2010

Tools developed by European researchers bring cut-and-paste simplicity to gaming and animation. Users will be able to cut-and-paste complex elements like emotion, tone of voice and facial expression, making compelling new ...

Software helps deaf and hearing communities interact

July 23, 2015

For most Americans, communication is an oral endeavor. We learn to speak and read through sound, to distinguish between hard and soft k's, to make the hiss of a double "s" or the slight lisp of a "th."

Recommended for you

Samsung to disable Note 7 phones in recall effort

December 9, 2016

Samsung announced Friday it would disable its Galaxy Note 7 smartphones in the US market to force remaining owners to stop using the devices, which were recalled for safety reasons.

Swiss unveil stratospheric solar plane

December 7, 2016

Just months after two Swiss pilots completed a historic round-the-world trip in a Sun-powered plane, another Swiss adventurer on Wednesday unveiled a solar plane aimed at reaching the stratosphere.

Solar panels repay their energy 'debt': study

December 6, 2016

The climate-friendly electricity generated by solar panels in the past 40 years has all but cancelled out the polluting energy used to produce them, a study said Tuesday.

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.