TUM robots 'Kinect' to sandwiches and popcorn

Dec 12, 2011 by Nancy Owano weblog

(PhysOrg.com) -- A robotics team from the Technical University of Munich are now able to show an audience how their cuisine robots James and Rosie have graduated from a previously famous repertoire of sausages and pancakes to making salami and cheese sandwiches and stovetop popcorn. The robots do so with an impressive measure of dexterity and precision in turning on a stove and the other tasks.

The robots, James and Rosie, can respond to orders like "make me a sandwich" with the use of visual-detection systems from an Xbox Kinect. They also use algorithms to assess surroundings, and to make inferences about what they see, in order to execute their tasks.

This video is not supported by your browser at this time.
James and Rosie Preparing Popcorn and Sandwiches (short version)

The make-me-a-sandwich goal of a toasted-bread salami and cheese sandwich with sandwich spread, for example, consists of complex actions. The team’s goal is developing robots that don’t need instructions for each and every step.

The video shows James and Rosie performing their tasks with precision. Moving around the pots, pouring popcorn neatly into a bowl, placing bread slices in the toaster, forking up items for the sandwich, all indicate the TUM team is making progress in developing "autonomous" robots that can perform everyday activities.

James and Rosie are part of the school’s CRAM project. CRAM stands for Cognitive Robot Abstract Machine. CRAM is a set of software tools to design and deploy robots that use cognition to manipulate items.

This video is not supported by your browser at this time.
Robotic Roommates Making Pancakes

The robots are kitted out with reasoning mechanisms all along the way that make them capable of decisions, rather than decisions that are pre-programmed. According to the Munich team, these robots can be more flexible and more reliable than robots using control programs without cognitive strengths.

According to TUM, CRAM “grounds symbolic expressions in the knowledge representation into the perception and actuation routines, and into the essential data structures of the control programs.” The CRAM kernel consists of the CPL plan language and the KnowRob knowledge processing system. Both are coupled to perception and actuation components.

The project notes also say that CRAM is designed to be highly modular; plug-ins can provide further cognitive capabilities.

James and Rosie belong to a family of four platforms in the lab: There are TUM-James (PR2), TUM Rosie, iCub and Bender. The PR2 is a standard research platform for mobile manipulation by Willow Garage. The PR2 Beta has a mobile base, two arms for manipulation, a sensor suite, and sixteen CPU cores for computation. Each PR2 Beta comes with the open source ROS robotics framework. TUM Rosie was built around the KUKA-omnidirectional base and KUKA-lightweight LWR-4 arms. Meantime, one might see further corners turned by robotics researchers at TUM. Their research will continue to explore how robots can perform everyday tasks such as setting tables, emptying dishwashers, and preparing meals.

This video is not supported by your browser at this time.
James and Rosie Preparing Popcorn and Sandwiches (Full Version)


Explore further: Congress gets mixed advice on regulating drones

More information: ias.cs.tum.edu/research/pr2beta

via IEEE

Related Stories

Kilobots bring us one step closer to a robot swarm

Jun 17, 2011

(PhysOrg.com) -- When you think about robots, the odds are that you think about something that is fairly large. Maybe you picture a robot arms bolted to the floor of a factory or if you are feeling particularly ...

Recommended for you

Congress gets mixed advice on regulating drones

May 17, 2013

(AP)—The growing use of unmanned surveillance "eyes in the sky" aircraft raises a thicket of privacy concerns, but the U.S. Congress is getting mixed advice on what, if anything, to do about it.

Makr Shakr uses three arms for drink-recipe collabs

May 15, 2013

(Phys.org) —We're told it's the wave of the future. Design, make, enjoy. Beyond home-based 3-D printers, there will be new machines and display screens and apps that will invite you to have day to day products ...

Nokia unveils metallic smartphone, stock tumbles (Update)

May 14, 2013

Nokia Corp. on Tuesday unveiled its first Lumia smartphone with a metal cover, low-light camera features and new social network apps. But the new model failed to impress investors, who sent the company's stock down more than ...

User comments : 1

Adjust slider to filter visible comments by rank

Display comments: newest first

Isaacsname
not rated yet Dec 12, 2011
World's most terrifying pancake-making robot has a shaky flip.

If the hand holding the spatula made a quick 180 rotation, pancakian surface friction will prevent said tasty cake from flying into an innocent bystander.

More news stories

Congress gets mixed advice on regulating drones

(AP)—The growing use of unmanned surveillance "eyes in the sky" aircraft raises a thicket of privacy concerns, but the U.S. Congress is getting mixed advice on what, if anything, to do about it.

Makr Shakr uses three arms for drink-recipe collabs

(Phys.org) —We're told it's the wave of the future. Design, make, enjoy. Beyond home-based 3-D printers, there will be new machines and display screens and apps that will invite you to have day to day products ...

RIM unveils cheaper BlackBerry (Update 2)

Research In Motion unveiled a lower-cost BlackBerry aimed at consumers in emerging markets on Tuesday, and said it will offer its once-popular BlackBerry Messenger service on iPhones and devices running Google's ...

US seizes Bitcoin operator accounts

US authorities seized the accounts of a Bitcoin digital currency exchange operator, claiming it was functioning as an "unlicensed money service business," court documents showed Friday.

Morocco to harness the wind in energy hunt

Morocco is ploughing ahead with a programme to boost wind energy production, particularly in the southern Tarfaya region, where Africa's largest wind farm is set to open in 2014.