When robots learn from our mistakes

May 26, 2011

(PhysOrg.com) -- Robots typically acquire new capacities by imitation. Now, EPFL scientists are doing the inverse -- developing machines that can learn more rapidly and outperform humans by starting from failed or inaccurate demonstrations.

A , unblinking, impassive, observes. Its instructor wants it to learn how to put a balloon in a basket 20 meters away. As the researcher demonstrates this task, which is difficult for a human to accomplish, she systematically misses the basket. Isn’t the scientist just wasting her time?

Typically looked at simply as useless mistakes, failed demonstrations can, on the contrary, be opportunities to learn better, claim scientists from EPFL’s Learning Algorithms and Systems Laboratory (LASA). Their unusual point of view has led to the development of novel algorithms.

“We inversed the principle, generally accepted in robotics, of acquisition by imitation, and considered cases in which humans are inaccurate in certain tasks,” explains professor Aude Billard, head of LASA. “This approach allows the robot to go further, to learn more quickly and above all, outperform the human,” notes postdoctoral researcher Dan Grollman, who was recently awarded a “Best Paper Award” for an article on the subject presented at the International Conference on Robotics and Automation (ICRA), in Shanghai.

Grollman based his work on what he calls the “Donut as I do” theory. He developed an algorithm that tells the robot not to reproduce a demonstrator’s inaccurate gesture. The machine will use this input to avoid repeating the mistake and to search for alternative solutions. Thus the choice of the term “donut” – a play on the words “do not” and “donut.” The hole in the middle is the incorrect gesture, which must be excluded, and the surrounding dough represents the field of potential solutions to explore.

“We were inspired by the way in which humans learn,” explains Billard. “Children often progress by making mistakes or by observing others’ mistakes and assimilating the fact that they must not reproduce them.”

This way of learning things is a “real step forward,” says Grollman, who adds that, after all, “isn’t the real goal to make robots that can do things we can’t?”

Explore further: The robot "Athena" carries new impulses for robotics research in its luggage

More information: Daniel Grollman, Aude Billard, "Donut As I Do: Learning From Failed Demonstrations".

Provided by Ecole Polytechnique Federale de Lausanne

4 /5 (5 votes)

Related Stories

Flying machines are YouTube sensation

Mar 22, 2011

(PhysOrg.com) -- The latest YouTube sensation isn’t a puppy that dances to Lady Gaga or a kitten that opens beer bottles. By using unmanned aerial vehicles called quadrotors, two Ph.D. candidates at the ...

Entanglement can help in classical communication

Mar 30, 2011

(PhysOrg.com) -- When most of us think of entanglement, our minds jump immediately to quantum communication. "Entanglement has become very well known and useful in quantum communication," Robert Prevedel tells PhysOrg.com. Preved ...

Modern society made up of all types

Nov 04, 2010

Modern society has an intense interest in classifying people into ‘types’, according to a University of Melbourne Cultural Historian, leading to potentially catastrophic life-changing outcomes for those typed – ...

Recommended for you

First steps for Hector the robot stick insect

Dec 16, 2014

A research team at Bielefeld University has succeeded in teaching the only robot of its kind in the world how to walk. Its first steps have been recorded in a video. The robot is called Hector, and its construction ...

Getting bot responders into shape

Dec 16, 2014

Sandia National Laboratories is tackling one of the biggest barriers to the use of robots in emergency response: energy efficiency.

Robot 'shadow hand'

Dec 12, 2014

Picking up an apple is one of those jobs requiring the delicate touch of the human hand – or its robotic counterpart.

Two robots, one challenge, endless possibility

Dec 11, 2014

To the theme song of "2001: A Space Odyssey," a robot with a twisty spine rolled toward Thomas Rosenbaum, the new president of the California Institute of Technology, on Oct. 24, as he stood on a stage at ...

User comments : 3

Adjust slider to filter visible comments by rank

Display comments: newest first

that_guy
5 / 5 (1) May 26, 2011
The robots will be talking among themselves "Obviously the humans are doing civilization all wrong. We need to wipe them out and do it all over, better."

Sorry, I couldn't help it.

Sincerely,
XRV-1a, robot overlord.
hush1
not rated yet May 27, 2011
Close. Fermi paradox solved.
...the real goal to make robots that can do things we cant?

The "talk" is: "been there, done it"..."and 'you' will too".

Of course their "talk" is without words. If they were force to use 'our' language to tell us about their "talk":

"beyond the potential that your continuum harbors"

We're sorry too, that your language cuts you so short (of us).

Sincerely,
"Until you join us"
p.s.
You won't recognize yourselves - your human form gone, by the time you join us. We will laugh together over what you once were.


ShadowRam
not rated yet Jun 13, 2011
Unimpressed.

Teach robot 1 end of the spectrum, and the other end.
It then just linearly test's each step between the 2 states until it finds the middle ground that equates to the success.

This is simple.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.