Robot's influent speaking just to get attention from you

October 22, 2015
A user interacting with the Talking-Ally robot. Credit: Toyohashi University Of Technology

Communication in human dialogue is based on one another's words and body language. We can sense whether the other person is distracted, and we change the course of our conversation and our actions to regain their attention.

Most existing robots, however, still use monologue mechanisms, even when engaging in dialogue with a person. For example, they continue speaking in the same way, even if the person is not paying .

Researchers at the Interactions and Communication Design (ICD) Lab at Toyohashi University of Technology have devised the novel robotic communication approach that takes into account the listener's attention. The robot follows a person's gaze and determines if that person is distracted by, for instance, a sports event in the background or something in their surroundings. The robot bends forward and nods if the person is watching television or it turns its head and looks around if the person is looking elsewhere. These behaviors are accompanied by appropriate utterance intended to regain the person's attention. Experiments have confirmed that these adaptive interactions considerably increase the other party's attention focused toward the robot as compared with the gestures and speech generated without considering the person's gaze.

"We have set up an environment to manipulate the person's attention with an engaging sports program broadcast simultaneously with the human-robot interaction. This allowed us to validate a suite of conversation situations and utterance-generation patterns," said Hitomi Matsushita, first author of the conference paper on the robot.

"Talking-Ally dynamically determines and synchronizes its , turn initials, and entrust behaviors within the speech, according to the person's attention coordinates," Professor Michio Okada, head of the ICD Lab, explained. "Our analysis shows that this is significantly more persuasive than generating these behaviors randomly."

The experimental results significantly contribute to the HRI community by confirming that adaptive communication is essential in acquiring and maintaining attention during conversation. Moreover, Talking-Ally demonstrates a specific communication protocol that is shown to successfully re-engage a distracted person. This is instrumental in achieving persuasive communication and convincing interaction with the robot. Such a platform can ultimately be tailored for use with any HRI application.

The video will load shortly
A user interacting with the Talking-Ally robot. Credit: Toyohashi University Of Technology

Talking-Ally currently chooses its responsive gestures at random from a set that suitably corresponds to the person's level of attention. Future work on the project will include further customizing the robot's interaction to individuals by choosing a specific body language to use in each situation based on subtle cues from the other party.

Explore further: Mind your manners, robot: How social cues influence human-robot interaction

More information: Naoki Ohshima, Yusuke Ohyama, Yuki Odahara, P. Ravindra S. De Silva, and Michio Okada (2015). Talking-Ally: The Influence of Robot Utterance Generation Mechanism on Hearer Behaviors, International Journal of Social Robotics, 7(1), 51-62.

Related Stories

Personality shapes the way our brains react to eye contact

June 5, 2015

Eye contact plays a crucial role when people initiate interaction with other people. If people look each other in the eye, they automatically send a signal that their attention is focused on the other person. If the other ...

Researchers aim to refocus wandering minds

October 9, 2015

We're all guilty of it at times. Whether it's reading a report, sitting through a meeting or listening to a classroom lecture, we've all realized, with a start, that our minds have wandered.

Recommended for you

Making it easier to collaborate on code

October 26, 2016

Git is an open-source system with a polarizing reputation among programmers. It's a powerful tool to help developers track changes to code, but many view it as prohibitively difficult to use.

Dutch unveil giant vacuum to clean outside air

October 25, 2016

Dutch inventors Tuesday unveiled what they called the world's first giant outside air vacuum cleaner—a large purifying system intended to filter out toxic tiny particles from the atmosphere surrounding the machine.


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.