Interactive communication technology for human symbiotic robot to enhance natural communication with humans

June 16, 2014

Hitachi today announced the development of interactive communication technology for the human symbiotic robot EMIEW2, which selects the optimal answer and explanation based on the subject and attributes included in a question, then based on body movement of the other party, such as nodding or tilting of the head to the side, estimates the level of comprehension to give an even more natural response. This technology enables even more flexible responses in relation to questions to realize smooth communication between humans and robots.

Hitachi has been developing human symbiotic robotics technology since it developed EMIEW in 2005. First announced in 2007, EMIEW2 has realized motor functions such as 2-wheel autonomous locomotion at 6 km/h, around the same pace as a fast walking person, predicting and avoiding collision, and intelligent functions such as distinguishing speech from background noise using 14 microphones, and identifying objects from information on the Internet, and guiding the enquirer to the object.

In the evolution of human symbiotic robots, free communication between humans and robots is the most important technology, and much research and development has been conducted in the area. Voice recognition, contents comprehension, response construction and voice synthesis technologies are required for technologies in free communication. In recent years, technology has been implemented such as in the mobile phone, where the subject is estimated from speech and a corresponding response is provided to the speaker. In robots, however, independent technology development was necessary as conversation is conducted at a distance with no hands-on operation by the speaker. This time, two technologies contributing to progress in robotics conversational function were developed and mounted in EMIEW2. Details of the technologies are as follow.

(1) Select the optimal response from several words included in the enquiry

The necessary words and word order required to identify the subject and attributes from prepared questions, are learnt and recorded in a data base. Technology was developed to recognize the subject and attributes of a question using to identify the and comparison with the database. With this technology, selection of the optimal response is realized for the subject and attributes of the question posed. Deep Learning, a machine learning method receiving much attention in the field of recognition, was used to enable a high level of recognition.

(2) Ascertain the enquirer's comprehension level from movement such as nodding and tilting of the head

Video images of EMIEW2 in dialogue with humans are pre-analyzed to study body movements accompanying responses. In actual conversation, EMIEW2 captures the movement of the enquirer with an internal camera, and identifies movement such as nodding or tilting of the head to the side. Technology was developed to determine the enquirer's level of comprehension by comparing the actual response to the expected response to EMIEW2's reply. Even more human-like conversation can be achieved by understanding the enquirer's level of comprehension in relation to nature of the reply.

Employing these two technologies, EMIEW2 is able to respond with the optimal answer to freely posed questions by recognizing the subject and attributes, and further respond accordingly by watching , facilitating smoother conversation.

Hitachi will continue to promote developments towards improving the practicality of human symbiotic service robots supporting humans, including interactive communication technology.

Explore further: Locate and guide function for the human symbiotic robot 'EMIEW2'

Related Stories

Japan's Hitachi unveils joking robot

May 20, 2014

Japanese scientists unveiled a robot with a sense of humour Tuesday, and claimed it was capable of knowing when its jokes had fallen flat.

Pepper the emotional robot may just make you angry

June 16, 2014

Softbank, a Japanese telecommunications giant, is selling what it is calling "the world's first personal robot that reads emotions". Pepper is designed to be a highly interactive household companion and was developed by Aldebaran, ...

Helping robots learn to walk

February 28, 2014

Fully autonomous robots could transform the way we live, but so far such machines remain beyond the reach of our most advanced technologies. Existing robots are generally limited to performing simple, well-structured tasks ...

Recommended for you

Enhancing solar power with diatoms

October 20, 2017

Diatoms, a kind of algae that reproduces prodigiously, have been called "the jewels of the sea" for their ability to manipulate light. Now, researchers hope to harness that property to boost solar technology.

Dutch open 'world's first 3D-printed bridge'

October 17, 2017

Dutch officials toasted on Tuesday the opening of what is being called the world's first 3D-printed concrete bridge, which is primarily meant to be used by cyclists.


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.