Robots learn to pick up oddly shaped objects

May 09, 2012 By Bill Steele
Robots learn to pick up oddly shaped objects
The universal jamming gripper picking up a pair of tongs. The trick is to decide where to grab.

(Phys.org) -- When Cornell engineers developed a new type of robot hand that could pick up oddly shaped objects it presented a challenge: It was easy for a human operator to choose the best place to take hold of an object, but an autonomous robot, like the ones we may someday have helping around the home or office, would need a new kind of programming. So they have developed a procedure -- an algorithm -- that allows a robot to learn grasping skills from experience and apply them in new situations.

Although inspired by the "universal jamming gripper" created in the lab of Hod Lipson, associate professor of and , the new method is "hardware agnostic," the researchers said, and will work with any type of gripper.

The work by Lipson and Ashutosh Saxena, assistant professor of computer science, a specialist in "machine learning," will be presented May 16 at the International Conference on Robotics and Automation in St. Paul, Minn. Co-authors of their paper are graduate students Yun Jiang and John Amend.

Robots learn to pick up oddly shaped objects
The new grasping algorithm was tested with a variety of objects.

Lipson's gripper consists of a flexible bag filled with a . As the bag settles on an it deforms to fit, then air is sucked out of the bag, causing the to pull together and tighten the grip. Previous grasping algorithms have been based on 3-D models of the object and the robot's gripping mechanism. A robot's computer brain creates an image of how its hand will look when attached to, say, a cup handle or pencil, and computes the needed to arrive in that position. But modeling how a deformable bag shapes around irregular objects is too hard to compute, so the researchers adopted a learning approach.

In a 3-D image of the object, the robot examines a series of rectangles that match the size of the gripper and tests each one on a variety of features. The robot is trained on images of many different objects until it has built a library of features common to good grasping rectangles. Presented with a new object, it chooses the rectangle with the highest score based on the rules it has discovered. For example, if a rectangle is divided into three strips and the center strip is higher than the other two, that might be a good place to grab.

The robot also considers the overall size and shape of the object to choose a stable grasping point. You don't want to pick up a heavy, irregular object by one end; but arbitrarily choosing the center may not work either. The "center" of a computer mouse is halfway along the cord.

To test the method the researchers fitted an industrial robot arm with the jamming gripper and a Microsoft Kinect 3-D camera. In trying to pick up 23 objects, including tools, toys and dishes, the robot succeeded an average of 90 percent to 100 percent of the time, depending on the type of object. In most cases, the robot was able to successfully grasp new objects that had not been in the training set. Deformable objects like a shoe or a purse were harder, with the robot averaging only 67 percent success.

They ran the same tests with a simple "pick it up at the center" directive, scoring only 30 percent to 50 percent, except on flat objects, where both approaches tied at 89 percent.

The algorithm also was tested with the standard parallel jaws most modern robots use, with about the same results, except that the jaws were 100 percent successful in picking up soft, deformable objects. A future robot may need interchangeable hands for different jobs. An extension of their work, the researchers said, might be to include a gripper selection feature.

Explore further: A robot dives into search for Malaysian Airlines flight

Related Stories

Robots could improve everyday life, do chores

Sep 21, 2010

(PhysOrg.com) -- They're mundane, yet daunting tasks: Tidying a messy room. Assembling a bookshelf from a kit of parts. Fetching a hairbrush for someone who can't do it herself. What if a robot could do it ...

Robots learn to handle objects, understand places

Sep 02, 2011

(PhysOrg.com) -- Infants spend their first few months learning to find their way around and manipulating objects, and they are very flexible about it: Cups can come in different shapes and sizes, but they ...

Robot fetches objects with just a point and a click

Mar 19, 2008

Robots are fluent in their native language of 1 and 0 absolutes but struggle to grasp the nuances and imprecise nature of human language. While scientists are making slow, incremental progress in their quest ...

Care-O-bot 3: Always at your service

Jul 01, 2008

Who doesn’t long for household help at times? Service robots will soon be able to relieve us of heavy, dirty, monotonous or irksome tasks. Research scientists have now presented a new generation of household ...

Recommended for you

A robot dives into search for Malaysian Airlines flight

20 hours ago

In the hunt for signs of Malaysian Airlines flight MH370—which disappeared on March 8 after deviating for unknown reasons from its scheduled flight path—all eyes today turn to a company that got its start ...

Simplicity is key to co-operative robots

Apr 16, 2014

A way of making hundreds—or even thousands—of tiny robots cluster to carry out tasks without using any memory or processing power has been developed by engineers at the University of Sheffield, UK.

Students turn $250 wheelchair into geo-positioning robot

Apr 16, 2014

Talk about your Craigslist finds! A team of student employees at The University of Alabama in Huntsville's Systems Management and Production Center (SMAP) combined inspiration with innovation to make a $250 ...

Using robots to study evolution

Apr 14, 2014

A new paper by OIST's Neural Computation Unit has demonstrated the usefulness of robots in studying evolution. Published in PLOS ONE, Stefan Elfwing, a researcher in Professor Kenji Doya's Unit, has succes ...

User comments : 2

Adjust slider to filter visible comments by rank

Display comments: newest first

Eoprime
5 / 5 (3) May 09, 2012
really old news...
Scottingham
not rated yet May 09, 2012
Eoprime beat me to it...this is incredibly old news. I think the only difference is now the AI can better plan how to use its gripper to properly pick up an object after some analysis.

More news stories

Health care site flagged in Heartbleed review

People with accounts on the enrollment website for President Barack Obama's signature health care law are being told to change their passwords following an administration-wide review of the government's vulnerability to the ...

Airbnb rental site raises $450 mn

Online lodging listings website Airbnb inked a $450 million funding deal with investors led by TPG, a source close to the matter said Friday.

Researchers uncover likely creator of Bitcoin

The primary author of the celebrated Bitcoin paper, and therefore probable creator of Bitcoin, is most likely Nick Szabo, a blogger and former George Washington University law professor, according to students ...