HEARBO robot can tell beeps, notes, and spoken word (w/ Video)

November 21, 2012 by Nancy Owano report

(Phys.org)—Research seeking to improve the features and functions of robots has made impressive gains with prototypes of robots that can help out in settings that range from assistive living, to hospital care, to inventory-taking retail stores. One area of robot technology receiving special attention at Honda is "robot audition." How effectively can scientists fashion robots that can hear? And, by hearing, how can hearing be ramped up to include speech recognition, even with noise interference? HEARBO, which stands for (HEAR-ing roBOt) is a robot that has been developed at Japan's Honda Research Institute–(HRI-JP), and its creators want HEARBO to stand out as an above-average example of how robots can understand sound. Their line of research is called Computational Auditory Scene Analysis.

In brief, HEARBO can pick up, distinguish, and analyze multiple simultaneous sound sources without difficulty. HEARBO's edge is in the word "analyze," as it can sift and sort different sounds going on at the same time, such as children playing on one side of the room, with a doorbell ringing on the other.

The Honda researchers say that the robot has a three-step process of: localization, separation, and recognition. Sound Source Localization (SSL) in robot audition conveys the location and number of sound sources, used for sound source separation. "Since robots should work in real-time and localize sound sources in a , SSL for robots mainly requires noise-robustness, high-resolution, and real-time processing," according to Honda researchers.

The video will load shortly

The team prepared a video to show how HEARBO is able to differentiate three sound sources around the robot, an ; music; and a person speaking. The robot is designed to capture all the sounds and determine their location, before focusing on each sound source.

The Japan Daily Press has enthused over Honda, saying it probably possesses "the most advanced Computer Auditory Scene Analysis System currently in existence." Honda itself is not shy about branding itself as a leading research seedbed for auditory analysis, saying that in past years "we became the first in the world to propose the research field of ' audition' combining research in auditory scene analysis and research of robots." Their intent has been to ensure that robots understand all sounds, not just voices, At the IROS 2012 (International Conference on Intelligent Robots and Systems), the new sound source localization algorithm for detecting sounds was presented.

The video will load shortly

The team refers to their software system that can distinguish simultaneous sounds as HARK, which stands for HRI-JP Audition for Robots with Kyoto University. By using HARK, they said who spoke and from where in a room can be recorded. Using the methods developed by the team at HRI-JP, up to four different simultaneous sounds or voices can be detected and recognized in practice.

As such, HEARBO's researchers are taking the "beamforming" approach to sound recognition a step further. They work from a premise that "noise" should not just be filtered out but rather separated out and then analyzed. HEARBO has been taught music, human voice, and environmental sounds.

HEARBO was trained with numerous different songs to learn about the general characteristics of music. HEARBO can tell the difference between a human issuing commands and a singer on the radio.

The team's intent is to generally advance intelligent speech and sound recognition technology.

Explore further: Musical robots perform duets (w/ Video)

More information: www.jp.honda-ri.com/english/projects/intelligence/03.html

Related Stories

Musical robots perform duets (w/ Video)

November 26, 2009

(PhysOrg.com) -- A flute playing robot unveiled by Waseda University last year has been joined by a robot saxophonist in a Classical music duet. The aim of the project was to design robots that could respond to each other's ...

Kilobots bring us one step closer to a robot swarm

June 17, 2011

(PhysOrg.com) -- When you think about robots, the odds are that you think about something that is fairly large. Maybe you picture a robot arms bolted to the floor of a factory or if you are feeling particularly dramatic maybe ...

Introducing Japan’s new singing robot (w/ Video)

October 15, 2010

(PhysOrg.com) -- A new humanoid robot, the HRP-4, has been unveiled at the CEATEC Japan 2010 trade show. The robot, nicknammed "diva-bot," has learned to sing by mimicking a human singer, enabling it to sound natural and ...

Honda plans nuclear mission for robot

August 12, 2011

Japan's Honda is hoping to retool its humanoid robot ASIMO for a nuclear mission so it can join emergency work inside the crippled Fukushima Daiichi plant, a press report said Friday.

Lend me your ears -- and the world will sound very different

January 14, 2008

Recognising people, objects or animals by the sound they make is an important survival skill and something most of us take for granted. But very similar objects can physically make very dissimilar sounds and we are able to ...

iRobot planning an Android-based robot

May 12, 2011

(PhysOrg.com) -- iRobot is working on robots that have the brains of an Android tablet. The goal is an Android-based tablet that is able to see the world around it, hear input from humans, respond and think about the next ...

Recommended for you

Making it easier to collaborate on code

October 26, 2016

Git is an open-source system with a polarizing reputation among programmers. It's a powerful tool to help developers track changes to code, but many view it as prohibitively difficult to use.

Dutch unveil giant vacuum to clean outside air

October 25, 2016

Dutch inventors Tuesday unveiled what they called the world's first giant outside air vacuum cleaner—a large purifying system intended to filter out toxic tiny particles from the atmosphere surrounding the machine.


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.