Beer-pouring robot programmed to anticipate human actions (w/ Video)

May 28, 2013

A robot in Cornell's Personal Robotics Lab has learned to foresee human action in order to step in and offer a helping hand, or more accurately, roll in and offer a helping claw.

Understanding when and where to pour a beer or knowing when to offer assistance opening a refrigerator door can be difficult for a because of the many variables it encounters while assessing the situation. A team from Cornell has created a solution.

Gazing intently with a Kinect 3-D camera and using a database of 3D videos, the Cornell robot identifies the activities it sees, considers what uses are possible with the objects in the scene and determines how those uses fit with the activities. It then generates a set of possible continuations into the future – such as eating, drinking, cleaning, putting away – and finally chooses the most probable. As the action continues, the robot constantly updates and refines its predictions.

This video is not supported by your browser at this time.

"We extract the general principles of how people behave," said Ashutosh Saxena, Cornell professor of and co-author of a new study tied to the research. "Drinking coffee is a big activity, but there are several parts to it." The robot builds a "" of such small parts that it can put together in various ways to recognize a variety of big activities, he explained.

Saxena will join Cornell graduate student Hema S. Koppula as they present their research at the International Conference of Machine Learning, June 18-21 in Atlanta, and the Robotics: Science and Systems conference June 24-28 in Berlin, Germany.

In tests, the robot made correct predictions 82 percent of the time when looking one second into the future, 71 percent correct for three seconds and 57 percent correct for 10 seconds.

"Even though humans are predictable, they are only predictable part of the time," Saxena said. "The future would be to figure out how the robot plans its action. Right now we are almost hard-coding the responses, but there should be a way for the robot to learn how to respond."

Explore further: Public needs convincing that robots can improve their quality of life

Related Stories

Teaching robots to identify human activities

Jul 19, 2011

(PhysOrg.com) -- If we someday live in "smart houses" or have personal robots to help around the home and office, they will need to be aware of what humans are doing. You don't remind grandpa to take his arthritis ...

Robots learn to handle objects, understand places

Sep 02, 2011

(PhysOrg.com) -- Infants spend their first few months learning to find their way around and manipulating objects, and they are very flexible about it: Cups can come in different shapes and sizes, but they ...

'Hallucinating' robots arrange objects for human use

Jun 18, 2012

(Phys.org) -- If you hire a robot to help you move into your new apartment, you won't have to send out for pizza. But you will have to give the robot a system for figuring out where things go. The best approach, ...

Recommended for you

Pleurobot is salamander-like robot with lifelike motion

Mar 04, 2015

A video showing "multimodal locomotion in a bioinspired robot" has been making the rounds, and the video demonstrates advances in robotics as scientific tools as well as potential robots for search and rescue ...

Kids and robots learn to write together (w/ Video)

Mar 04, 2015

Who is the teacher: the student or the machine? By showing a robot how to write letters, children improve their writing skills and gain self-‐confidence. This system, called CoWriter, was developed by EPFL researchers.

Evolving robot brains

Mar 02, 2015

Researchers are using the principles of Darwinian evolution to develop robot brains that can navigate mazes, identify and catch falling objects, and work as a group to determine in which order they should ...

User comments : 2

Adjust slider to filter visible comments by rank

Display comments: newest first

grondilu
5 / 5 (1) May 28, 2013
I can already hear bar tenders shouting "they took our jobs".
ValeriaT
5 / 5 (1) May 28, 2013
What will happen, when robot doesn't anticipate the human action well..

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.