Big NSF grant funds research into training robots to work with humans

Dec 18, 2012 by Carol Ness
Big NSF grant funds research into training robots to work with humans
Berkeley professors Ken Goldberg, center, and Pieter Abbeel, right, work on the RAVEN surgical robot in a Soda Hall lab, with an assist from graduate student Animesh Garg, left. Credit: Cheryl Martinez photos

What if robots and humans, working together, were able to perform tasks in surgery and manufacturing that neither can do alone?

That's the question driving new research by UC Berkeley robotics experts Ken Goldberg and Pieter Abbeel and colleagues from four other universities, who were awarded a $3.5 million grant from the National Science Foundation.

Their work is part of the first $50 million in funding for the National Robotics Initiative, announced in 2011 with the goal of exploring how robots can enhance the work of humans rather than replacing them,

"The emerging generation of robots are more aware than oblivious, more social than solitary, and more like companions that tools," says Goldberg, a professor in the departments of Industrial Engineering and and  Electrical Engineering and Computer Sciences.

The four-year project, a collaboration of experts at Berkeley, Stanford, Johns Hopkins, UC Santa Cruz and the University of Washington, will focus on ways that robots can be trained by humans to perform "multilateral manipulation," with one or more humans providing perception and and robots providing speed, precision, accuracy and , the researchers described it in their grant application.

Big NSF grant funds research into training robots to work with humans
Close-up of one of the RAVEN robot’s two pincers, which can hold a needle for simulated suturing.

In surgery, for example, a human- could mean an extra set of "hands" for or suturing for a doctor focusing on more complex procedures. The concept envisions something quite different from tele-surgery, where a remote surgeon controls directly; the next generation of robots would function autonomously, but with training and supervision by humans and reliance on algorithms and data libraries compiled by humans. 

In manufacturing, such human-robot systems could learn to handle tasks such as threading wires or cables, or aligning gaskets. In households, they could wrap packages or fold laundry.

All of these examples revolve around the idea of teaching a robot to properly handle objects whose size and shape can be variable, because they're made of malleable materials.  Examples include strings, wires, sheets, and cushions and organs.

Abbeel, an assistant professor in EECS, has done groundbreaking work in this area; he programmed a robot to pick up, recognize and fold towels crumpled in a random pile. A video shows the robot in action.

This video is not supported by your browser at this time.

"Robotics is at an inflection point," says Goldberg, pointing to some 5 million household robots, 10,000 military robots and 2,000 surgical robots adopted over the past decade. An emerging new paradigm is "cloud robotics," in which robots no longer have to be self-contained but instead are designed to tap vast global stores of information, parallel computing power, data sharing and open-source programming.

Berkeley is a leading center for robot learning and cloud robotics, notes Goldberg. With researchers at Google, he recently submitted a paper on a trained to recognize and grasp objects using Google Goggles, a "crowd-sourced" online database of images of objects.

More information is available on the project website.

Also available online is information about the RAVEN surgical robotic system that Goldberg, Abbeel and others at Berkeley are working on, and on Goldberg's cloud robotics site.

Explore further: Flying robots will go where humans can't

add to favorites email to friend print save as pdf

Related Stories

Researchers develop a robot that folds towels (w/ Video)

Apr 05, 2010

(PhysOrg.com) -- A team from Berkeley's Electrical Engineering and Computer Sciences department has figured out how to get a robot to fold previously unseen towels of different sizes. Their approach solves a key problem in ...

Futuristic robots, friend or foe?

Apr 22, 2008

A leading robotics expert will outline some of the ethical pitfalls of near-future robots to a Parliamentary group today at the House of Commons. Professor Noel Sharkey from the University of Sheffield will explain that robots ...

Thanks to RoboEarth the bots can learn on their own

Feb 10, 2011

(PhysOrg.com) -- We tend to assume that robots need human input in order to understand the world around them. In the near future humans may not even be a part of the robotic-learning equation. Soon, robots ...

It's a bird, it's a plane, it's a robot bird (w/ video)

Mar 29, 2011

(PhysOrg.com) -- The great thing about robots is that they come in all shapes and sizes. Of course, that is also one of the creepiest things about robots too. You never know what is going to be a robot these ...

Recommended for you

Flying robots will go where humans can't

Sep 17, 2014

There are many situations where it's impossible, complicated or too time-consuming for humans to enter and carry out operations. Think of contaminated areas following a nuclear accident, or the need to erect ...

Will tomorrow's robots move like snakes?

Sep 16, 2014

Over the last few years, researchers at MIT's Computer Science and Artificial Intelligence Lab (CSAIL) have developed biologically inspired robots designed to fly like falcons, perch like pigeons, and swim ...

Robot Boris learning to load a dishwasher (w/ Video)

Sep 12, 2014

Researchers at the University of Birmingham in the U.K. have set themselves an ambitious goal: programming a robot in such a way as to allow it to collect dishes, cutlery, etc. from a dinner table, and put ...

Deep-sea diver hand offers freedom and feedback

Sep 12, 2014

Bodyskins and goggles are hardly the solution for divers who need to reach extreme depths. The Atmospheric Dive Suit (ADS) gives them the protection they need. Recently, The Economist detailed a technology ...

User comments : 1

Adjust slider to filter visible comments by rank

Display comments: newest first

Soengiac
not rated yet Dec 28, 2012
Love it.