Realistic robot faces aren't enough – we need emotion to put us at ease with androids

June 19, 2015 by Stephanie Lay And Graham Pike, The Conversation
How can I serve you? Credit: Franck Robichon/EPA

When the first guests arrive at Nagasaki's Hotel Henn Na in July this year, they will be greeted and served by robots. In a similar approach, Toshiba's android Aiko recently held a short-term role greeting customers at a department store in Tokyo. Customers were comfortable approaching Aiko to ask for directions and even the receptionist who normally holds the post felt her android colleague was doing a reasonable job.

There is no doubt that developments in android technology mean that robots now look more lifelike than ever. It is even possible to imagine mistaking a robot such as Aiko for a human, at least at first glance. However, encountering near-human agents may not always be a comfortable experience.

Hotel Henn Na claims it is looking to explore the elements that "personify" hotels and to recreate that by using person-like entities. The big question is how people interact with robots, such as Aiko, that have a human appearance. Such interactions require considerably more than a robot with an apparently human face.

Our research at the Open University has considered aspects of how it might feel to be in a situation similar to interacting with a . It asks whether the properties of a robot receptionist's appearance and behaviour are able to make us feel comfortable or may make us decidedly uncomfortable. Our work into the so-called uncanny valley effect also suggests that a key aspect of such interactions will be the ability of the robot to reproduce and convey realistic emotions, particularly through their facial expressions.

The uncanny valley effect is now a well-known relationship how "human-like" a robot is and how comfortable people feel when interacting with it. There is a point where something can seem too close to human to be comfortable – and our research has explored some explanations for why this might occur. For a long time, research in this area was mainly focused on the practical aspects of how near-human agents appear and on the techniques that might make them look more realistic and acceptable enough to bridge this uncanny valley.

Our early research had observed that some of the eeriest and most unsettling near-human agents were those with exaggerated features, such as a "cute" doll with dark, wide and blank eyes. Building on the idea of disturbing facial features, our more recent research looked at the role of emotions in the uncanny valley effect and considered whether that eeriness may actually be a result of those near-human faces being unable to present realistic emotional expressions.

Most of the research into this area has considered how artificial faces can be made to appear more human-like, but we looked at how even human faces can appear eerie under certain conditions. We have found that when parts of photographs of faces posing emotional expressions were combined, certain combinations of emotions evoked a sense of eeriness. This effect was particularly strong when happy mouths were paired with scared or angry eyes.

In other words, encountering a face where the mouth is clearly smiling, but the eyes are not displaying the same emotion, can be quite disturbing. It follows that unless a robot face can display emotions accurately and appropriately, just as a human would, a human viewer could be left with a distinct feeling of unease.

So, it will be a long time before human receptionists superseded. Even now that the design of robot faces is at a point where they can be made to appear human-like, robots will need better abilities to be able to perform convincing emotional interactions.

Creating near-human agents that can portray genuinely believable presents a highly complex technological challenge. So while this tension between appearance and emotional interaction may currently confine robots to the uncanny valley, it could also offer a way out.

An alternative would be for designers to avoid trying to mimic human faces too closely until technology has progressed to allow their feelings to be represented realistically as well. Otherwise, our expectations about emotions would just be raised by the their human-like nature and then not met by their expressive ability. Choosing to make robots less human in appearance could avoid a constant race where robots that appear more human-like also require ever more convincing emotional abilities, offering a way around the .

Explore further: Why the fear of zombies? Look at the eyes

Related Stories

Why the fear of zombies? Look at the eyes

October 31, 2013

Zombies are undergoing a revival. Our screens have been filled with films such as "Zombieland", "World War Z" and "Resident Evil". Many home-made zombie will be knocking at our doors this week for Halloween. But what is it ...

Uncanny Valley robots essay resurfaces 42 years later

June 13, 2012

( -- An essay on robots by a professor in Japan over 40 years ago has just got its official translation. Many in robotics and other science circles will say better late than never for an official translation of Yasahiro ...

Recommended for you

Volvo to supply Uber with self-driving cars (Update)

November 20, 2017

Swedish carmaker Volvo Cars said Monday it has signed an agreement to supply "tens of thousands" of self-driving cars to Uber, as the ride-sharing company battles a number of different controversies.

New method analyzes corn kernel characteristics

November 17, 2017

An ear of corn averages about 800 kernels. A traditional field method to estimate the number of kernels on the ear is to manually count the number of rows and multiply by the number of kernels in one length of the ear. With ...


Adjust slider to filter visible comments by rank

Display comments: newest first

5 / 5 (1) Jun 19, 2015
The media constantly reports on "Robots" and "androids" as if they were a fact and while they aren't much more than very simple puppets of no practical use.

So, what's newsworthy or interesting in feeling or not at ease with a few puppets?
not rated yet Jun 19, 2015
The media constantly reports on "Robots" and "androids" as if they were a fact and while they aren't much more than very simple puppets of no practical use.

So, what's newsworthy or interesting in feeling or not at ease with a few puppets?

LOL..barely to the level of a common human.

But in any case, the need for "emotions" to feel "comfortable" is not a "need" of a higher life form....maybe they mean common humans need it for us to successfully market them?

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.