Intelligent Computers See Your Human Traits

May 29, 2008 By Lisa Zyga feature
Intelligent Computers See Your Human Traits
Researchers are developing human-centered computer systems that can recognize human traits such as emotional state and age. Image Credit: Guillaume Duchenne. (Appeared in Charles Darwin´s The Expression of the Emotions in Man and Animals in 1872.)

Today’s computers can do a lot as far as computation goes, but they tend to do it in an impersonal, stand-offish way, so to speak. However, computer engineers are busy changing that, as they try to give computers a bit of a personal touch to make human-computer interaction more natural and friendly.

For instance, two studies from a recent issue of IEEE Transactions on Multimedia have investigated enabling computers to recognize users’ emotional states and ages. The researchers hope that tomorrow’s computers will be able to “look” at a human face and extract this type of information, much like humans do with each other.

Emotional Detection

By combining audio and visual data, Yongjin Wang from the University of Toronto and Ling Guan from Ryerson University in Toronto have developed a system that recognizes six human emotional states: happiness, sadness, anger, fear, surprise, and disgust. Their system can recognize emotions in people from different cultures and who speak different languages with a success rate of 82%.

“Human-centered computing focuses on understanding humans, including recognition of face, emotions, gestures, speech, body movements, etc.,” Wang told PhysOrg.com. “Emotion recognition systems help the computer to understand the affective state of the user, and hence the computer can respond accordingly based on that perception.”

The researchers’ system extracted a large number of vocal characteristics, such as “prosodic features,” which include the rhythm, intensity, rate, and frequency of speech. Facial features were extracted holistically. Then, the researchers trained the system on several short video samples of individuals showing different emotions, from which it connected certain features with emotions.

As Wang and Guan explained, emotional representation is very diverse: some vocal and facial features may play an important role in characterizing certain emotions, but a very minimal role in other emotions. As a general example, happiness is detected better using certain visual features (e.g. in smiling), while anger is detected better using audio features (e.g. in yelling). The researchers found that there is not even one single feature that plays a significant role in all six emotions. While this finding shows that there are no sharp boundaries between emotions, it also makes it difficult for computers to distinguish emotions.

To approach this challenge, Wang and Guan used a step-by-step method, which added one feature at a time and then removed one at a time to find the most relevant features for identifying the unknown emotion. Then they used a multi-classifier scheme as a “divide and conquer” approach to separate possible emotions based on combinations of facial and vocal features.

“The most difficult part of enabling a computer to detect human emotion is the vast variance and diversity of vocal and facial expressions due to factors such as language, culture, and individual personality, etc.,” Wang explained. “Also, as shown in our paper, there are no sharp boundaries between different emotions. The accurate identification of discriminate patterns is a challenging problem.”

The researchers suggest that a computer that can recognize human emotion could one day have applications in customer service, computer games, security/surveillance, and educational software.

Age Estimation

While most people are pretty good at telling if someone is happy or upset, determining another person’s age just by looking at them is often an even bigger challenge, at least for humans. Computer engineers Yun Fu and Thomas Huang from the University of Illinois have trained a computer system to estimate a person’s age based on their facial features.

“Human age is one of the most important attributes that can infer individual condition, anthropometric information and social background,” Fu said. “The human-centered computing systems may concern more information from people in social groups than conventional computing systems, by focusing on the ways people organize and improve their lives around computational technologies.”

Fu and Huang worked with a database of facial images from 1600 subjects, half male and half female. Using results from previous age estimation systems, as well as a new aging characteristic they identified, the researchers trained a computer system to estimate human ages from 0 to 93 years. Their most successful algorithm could estimate a person’s age – based only on a few training images – to within five years or less 50% of the time, and within 10 years or less 83% of the time.

The researchers predict that age-recognition algorithms could have uses in preventing young kids access to adult Web sites, stopping vending machines from selling alcohol to underage individuals, and determining the age demographic of people who spend more time viewing certain advertisements.

By integrating human factors into computing, researchers will continue to bridge the gap between technology and people – and no doubt produce many more futuristic applications.

More information:

Wang, Yongjin, and Guan, Ling. “Recognizing Human Emotional State From Audiovisual Signals.” IEEE Transactions on Multimedia, Vol. 10, No. 4, June 2008, pp 659-668.

Fu, Yun, and Huang, Thomas S. “Human Age Estimation With Regression on Discriminative Aging Manifold.” IEEE Transactions on Multimedia, Vol. 10, No. 4, June 2008, pp 578-583.

Copyright 2008 PhysOrg.com.
All rights reserved. This material may not be published, broadcast, rewritten or redistributed in whole or part without the express written permission of PhysOrg.com.

Explore further: Researchers developing algorithms to detect fake reviews

add to favorites email to friend print save as pdf

Related Stories

Google's streaming music service adds mood to mix

11 hours ago

Google's music-subscription service will try to anticipate its listeners' mood swings as it amplifies its competition with Pandora, Spotify and other popular services that play tunes over the Internet.

Computerized emotion detector

Sep 16, 2014

Face recognition software measures various parameters in a mug shot, such as the distance between the person's eyes, the height from lip to top of their nose and various other metrics and then compares it with photos of people ...

Avatars make the Internet sign to deaf people

Aug 29, 2014

It is challenging for deaf people to learn a sound-based language, since they are physically not able to hear those sounds. Hence, most of them struggle with written language as well as with text reading ...

Recommended for you

Tablets, cars drive AT&T wireless gains—not phones

7 hours ago

AT&T says it gained 2 million wireless subscribers in the latest quarter, but most were from non-phone services such as tablets and Internet-connected cars. The company is facing pricing pressure from smaller rivals T-Mobile ...

Twitter looks to weave into more mobile apps

7 hours ago

Twitter on Wednesday set out to weave itself into mobile applications with a free "Fabric" platform to help developers build better programs and make more money.

Blink, point, solve an equation: Introducing PhotoMath

8 hours ago

"Ma, can I go now? My phone did my homework." PhotoMath, from the software development company MicroBlink, will make the student's phone do math homework. Just point the camera towards the mathematical expression, ...

Google unveils app for managing Gmail inboxes

8 hours ago

Google is introducing an application designed to make it easier for its Gmail users to find and manage important information that can often become buried in their inboxes.

User comments : 8

Adjust slider to filter visible comments by rank

Display comments: newest first

Gregori
4 / 5 (3) May 29, 2008
If they make the computer program reliable, easy to use and that it always does what its supposed to, I won't get angry at it and therefore won't need placated like a small child by a machine.
itistoday
5 / 5 (1) May 29, 2008
I agree with you Mr. Gregori (I'm a developer myself), but I believe this article is referring to the possibility of new kinds of software, e.g.:

"The researchers suggest that a computer that can recognize human emotion could one day have applications in customer service, computer games, security/surveillance, and educational software. "
nilbud
not rated yet May 29, 2008
So they seem to think guessing a woman's age accurately is a good thing, pfff.
RogerB34
not rated yet May 29, 2008
"Intelligent Computers See Your Human Traits"
The "Intellignet Computer" will spot Human Ignorance? May not be a large accomplishment.
vinhtho
not rated yet Jun 02, 2008
I cannot understand this sentence: "Their most successful algorithm could estimate a person's %u2013 based only on a few training images %u2013 to within five years or less 50% of the time, and within 10 years or less 83% of the time." Please let me know what rate of accuracy this algorithm may reach. Thank you a lot.
vinhtho
not rated yet Jun 02, 2008
I cannot understand this sentence: "Their most successful algorithm could estimate a person's -- based only on a few training images -- to within five years or less 50% of the time, and within 10 years or less 83% of the time." Please let me know what rate of accuracy this algorithm may reach. Thank you a lot.
vinhtho
not rated yet Jun 02, 2008
I cannot understand this sentence: "Their most successful algorithm could estimate a person's -- based only on a few training images -- to within five years or less 50% of the time, and within 10 years or less 83% of the time." Please let me know what rate of accuracy this algorithm may reach. Thank you a lot
hibiscus
not rated yet Jun 09, 2008
Now Google can start milking our emotions too?

"Please install our emotional toolbar for better search results"

And after a while the 90% cows in this world have installed that piece of crap for sure.