When robots learn from our mistakes

May 26, 2011

(PhysOrg.com) -- Robots typically acquire new capacities by imitation. Now, EPFL scientists are doing the inverse -- developing machines that can learn more rapidly and outperform humans by starting from failed or inaccurate demonstrations.

A , unblinking, impassive, observes. Its instructor wants it to learn how to put a balloon in a basket 20 meters away. As the researcher demonstrates this task, which is difficult for a human to accomplish, she systematically misses the basket. Isn’t the scientist just wasting her time?

Typically looked at simply as useless mistakes, failed demonstrations can, on the contrary, be opportunities to learn better, claim scientists from EPFL’s Learning Algorithms and Systems Laboratory (LASA). Their unusual point of view has led to the development of novel algorithms.

“We inversed the principle, generally accepted in robotics, of acquisition by imitation, and considered cases in which humans are inaccurate in certain tasks,” explains professor Aude Billard, head of LASA. “This approach allows the robot to go further, to learn more quickly and above all, outperform the human,” notes postdoctoral researcher Dan Grollman, who was recently awarded a “Best Paper Award” for an article on the subject presented at the International Conference on Robotics and Automation (ICRA), in Shanghai.

Grollman based his work on what he calls the “Donut as I do” theory. He developed an algorithm that tells the robot not to reproduce a demonstrator’s inaccurate gesture. The machine will use this input to avoid repeating the mistake and to search for alternative solutions. Thus the choice of the term “donut” – a play on the words “do not” and “donut.” The hole in the middle is the incorrect gesture, which must be excluded, and the surrounding dough represents the field of potential solutions to explore.

“We were inspired by the way in which humans learn,” explains Billard. “Children often progress by making mistakes or by observing others’ mistakes and assimilating the fact that they must not reproduce them.”

This way of learning things is a “real step forward,” says Grollman, who adds that, after all, “isn’t the real goal to make robots that can do things we can’t?”

Explore further: A robot dives into search for Malaysian Airlines flight

More information: Daniel Grollman, Aude Billard, "Donut As I Do: Learning From Failed Demonstrations".

Provided by Ecole Polytechnique Federale de Lausanne

4 /5 (5 votes)

Related Stories

Flying machines are YouTube sensation

Mar 22, 2011

(PhysOrg.com) -- The latest YouTube sensation isn’t a puppy that dances to Lady Gaga or a kitten that opens beer bottles. By using unmanned aerial vehicles called quadrotors, two Ph.D. candidates at the ...

Entanglement can help in classical communication

Mar 30, 2011

(PhysOrg.com) -- When most of us think of entanglement, our minds jump immediately to quantum communication. "Entanglement has become very well known and useful in quantum communication," Robert Prevedel tells PhysOrg.com. Preved ...

Modern society made up of all types

Nov 04, 2010

Modern society has an intense interest in classifying people into ‘types’, according to a University of Melbourne Cultural Historian, leading to potentially catastrophic life-changing outcomes for those typed – ...

Recommended for you

A robot dives into search for Malaysian Airlines flight

Apr 18, 2014

In the hunt for signs of Malaysian Airlines flight MH370—which disappeared on March 8 after deviating for unknown reasons from its scheduled flight path—all eyes today turn to a company that got its start ...

Simplicity is key to co-operative robots

Apr 16, 2014

A way of making hundreds—or even thousands—of tiny robots cluster to carry out tasks without using any memory or processing power has been developed by engineers at the University of Sheffield, UK.

Students turn $250 wheelchair into geo-positioning robot

Apr 16, 2014

Talk about your Craigslist finds! A team of student employees at The University of Alabama in Huntsville's Systems Management and Production Center (SMAP) combined inspiration with innovation to make a $250 ...

Using robots to study evolution

Apr 14, 2014

A new paper by OIST's Neural Computation Unit has demonstrated the usefulness of robots in studying evolution. Published in PLOS ONE, Stefan Elfwing, a researcher in Professor Kenji Doya's Unit, has succes ...

User comments : 3

Adjust slider to filter visible comments by rank

Display comments: newest first

that_guy
5 / 5 (1) May 26, 2011
The robots will be talking among themselves "Obviously the humans are doing civilization all wrong. We need to wipe them out and do it all over, better."

Sorry, I couldn't help it.

Sincerely,
XRV-1a, robot overlord.
hush1
not rated yet May 27, 2011
Close. Fermi paradox solved.
...the real goal to make robots that can do things we cant?

The "talk" is: "been there, done it"..."and 'you' will too".

Of course their "talk" is without words. If they were force to use 'our' language to tell us about their "talk":

"beyond the potential that your continuum harbors"

We're sorry too, that your language cuts you so short (of us).

Sincerely,
"Until you join us"
p.s.
You won't recognize yourselves - your human form gone, by the time you join us. We will laugh together over what you once were.


ShadowRam
not rated yet Jun 13, 2011
Unimpressed.

Teach robot 1 end of the spectrum, and the other end.
It then just linearly test's each step between the 2 states until it finds the middle ground that equates to the success.

This is simple.

More news stories

Airbnb rental site raises $450 mn

Online lodging listings website Airbnb inked a $450 million funding deal with investors led by TPG, a source close to the matter said Friday.

Health care site flagged in Heartbleed review

People with accounts on the enrollment website for President Barack Obama's signature health care law are being told to change their passwords following an administration-wide review of the government's vulnerability to the ...