First live 'cloning' of faces challenges assumptions about human behavior

Jun 01, 2009

(PhysOrg.com) -- Computer scientists at the University of East Anglia (UEA) have developed a new way of cloning facial expressions during live conversations to help us better understand what influences our behaviour when we communicate with others.

Published this month in the peer-reviewed journal Language & Speech, the new technique tracks in real time and head movements during a video conference and maps these movements to models of faces - producing a 'cloned' face.

These facial expressions and head movements can be manipulated live to alter the apparent expressiveness, identity, race, or even gender of a talker. Moreover, these visual cues can be manipulated such that neither participant in the conversation is aware of the manipulation.

Developed by Dr Barry-John Theobald of UEA's School of Computing Sciences, in collaboration with Dr Iain Matthews (Disney Research), Prof Steven Boker (University of Virginia) and Prof Jeffrey Cohn (University of Pittsburgh), the new facial expression cloning technique is already being trialed by psychologists in the US to challenge pre-conceived assumptions about how humans behave during conversations.

For example, it is well-known that you move your head differently when speaking to a woman than when speaking to a man. The new software has helped show that this difference is not because of your conversational partner's appearance, but instead due to the way they move. If a person appears to be a woman but moves like a man, others will respond with movements similar to those made when speaking to a man.

It is also likely to have application in the entertainment industry where life-like animated characters might be required.

"Spoken words are supplemented with non-verbal visual cues to enhance the meaning of what we are saying, signify our emotional state, or provide feedback during a face-to-face conversation," said Dr Theobald, lead author of the new paper. "Being able to manipulate these properties in a controlled manner allows us to measure precisely their effects on behaviour during conversation.

"This exciting new technology allows us to manipulate faces in this way for the first time. Many of these effects would otherwise be impossible to achieve, even using highly-skilled actors."

More information: 'Mapping and Manipulating Facial Expression' by Barry-John Theobald (UEA), Iain Matthews (Weta Digital Ltd, New Zealand), Michael Mangini (University of Notre Dame, US), Jeffrey Spies (University of Virginia), Timothy Brick (University of Virginia), Jeffrey Cohn (University of Pittsburgh) and Steven Boker (University of Virginia) is published in the June edition of Language and Speech.

Source: University of East Anglia

Explore further: Ant colonies help evacuees in disaster zones

add to favorites email to friend print save as pdf

Related Stories

Body language more expressive than faces

Oct 24, 2005

Body language can shape first impressions of a person's emotional state, even when attention is focused on facial expression, Netherlands scientists said.

Face to face - in realistic 3D

Mar 14, 2005

UK experts develop super-realistic animation system Computing experts at Cardiff University, UK, are developing a super-realistic animation system that simulates the movements of a face, based on speech. The team in the School of Com ...

Recommended for you

Ant colonies help evacuees in disaster zones

Apr 16, 2014

An escape route mapping system based on the behavior of ant colonies could give evacuees a better chance of reaching safe harbor after a natural disaster or terrorist attack by building a map of showing the shortest routes ...

User comments : 1

Adjust slider to filter visible comments by rank

Display comments: newest first

jldb
not rated yet Jun 01, 2009
This is cool. Maybe the producers of Fox's "lie to me" could incorporate some of this modeling into a plot line for next season -- or perhaps invite one of the authors for a cameo.

More news stories

Net neutrality balancing act

Researchers in Italy, writing in the International Journal of Technology, Policy and Management have demonstrated that net neutrality benefits content creator and consumers without compromising provider innovation nor pr ...

Cosmologists weigh cosmic filaments and voids

(Phys.org) —Cosmologists have established that much of the stuff of the universe is made of dark matter, a mysterious, invisible substance that can't be directly detected but which exerts a gravitational ...

Bionic ankle 'emulates nature'

These days, Hugh Herr, an associate professor of media arts and sciences at MIT, gets about 100 emails daily from people across the world interested in his bionic limbs.