Teaching robots lateral thinking: New algorithms could help household robots work around their physical shortcomings

Feb 25, 2013 by Larry Hardesty

Many commercial robotic arms perform what roboticists call "pick and place" tasks: The arm picks up an object in one location and places it in another. Usually, the objects—say, automobile components along an assembly line—are positioned so that the arm can easily grasp them; the appendage that does the grasping may even be tailored to the objects' shape.

General-purpose household robots, however, would have to be able to manipulate objects of any shape, left in any location. And today, commercially available robots don't have anything like the of the human hand.

At this year's IEEE International Conference on Robotics and Automation, students in the Learning and Intelligent Systems Group at MIT's Computer Science and Artificial Intelligence Laboratory will present a pair of papers showing how household robots could use a little lateral thinking to compensate for their physical shortcomings.

One of the papers concentrates on picking, the other on placing. Jennifer Barry, a in the group, describes an algorithm that enables a to push an object across a table so that part of it hangs off the edge, where it can be grasped. Annie Holladay, an MIT senior majoring in electrical engineering and computer science, shows how a two-armed robot can use one of its graspers to steady an object set in place by the other.

Colliding approaches

Most experimental general-purpose robots use a motion-planning algorithm called the rapidly exploring random tree, which maps out a limited number of -free through the robot's environment—rather like a subway map overlaid on the map of a city. A sophisticated-enough robot might have arms with seven different joints; if the robot is also mounted on a mobile base—as was the Willow Garage that the MIT researchers used—then checking for collisions could mean searching a 10-.

Add in a three-dimensional object with three different axes of orientation, which the robot has to push across a table, and the size of the search space swells to 16 dimensions, which is too large to search efficiently. Barry's first step was to find a concise way to represent the physical properties of the object to be pushed—how it would respond to different forces applied from different directions. Armed with that description, she could characterize a much smaller space of motions that would propel the object in useful directions. "This allows us to focus the search on interesting parts of the space rather than simply flailing around in 16 dimensions," she says. Finally, after her modification of the motion-planning algorithm, she had to "make sure that the theoretical guarantees of the planner still hold," she says.

This video is not supported by your browser at this time.

By contrast, Holladay's algorithm in some sense inverts the ordinary motion-planning task. Rather than identifying paths that avoid collisions and adhering to them, it identifies paths that introduce collisions and seals them off. If the robot is using one hand to set down an object that's prone to tipping over, for instance, "I might look for a place for the other hand that will block bad paths and kind of funnel the object into the path that I want," Holladay says.

Like Barry, Holladay had to find a simple method of representing the physical properties of the object the robot is manipulating. In addition to the placement of tall, tippy objects, her algorithm can also handle cases in which the robot is setting an object on a table, but the object sticks to the rubber sheath of the robot's gripper. With Holladay's algorithm, the robot can use its free gripper to prevent the object from sliding as it withdraws the other gripper.

Independent learning

Both Barry and Holladay allow modification of their algorithms, through application programming interfaces that would allow other researchers to plug in parameters describing the physical behavior of new types of objects. But the ultimate goal is for the robot itself to infer the relevant properties of objects by lifting, shoving, or otherwise manipulating them.

Nor are the researchers concerned that hardware improvements will render their algorithmic research obsolete. "The thought is that we're unlikely to get hands that are as flexible and dexterous as human hands, and even if we did, it would be hard to figure out the AI and planning for those," Barry says. "So we'll always have to think about interesting ways to grasp things."

"You see a lot of demos where a robot might do something like slide plates, but it's usually hard-coded for the demo: The robot knows that at this point, it needs to do this action for this particular thing," says Kaijen Hsiao, a research scientist and manager at Willow Garage, the company that manufactures the PR2. Barry and Holladay's research, by contrast, is "a framework for incorporating behaviors like that as a more general motion-planning problem," she says. "Which is a very difficult thing, because it's very high-dimensional. I think it's really important research, and it's very novel."

Explore further: A robot dives into search for Malaysian Airlines flight

Related Stories

Robots learn to pick up oddly shaped objects

May 09, 2012

(Phys.org) -- When Cornell engineers developed a new type of robot hand that could pick up oddly shaped objects it presented a challenge: It was easy for a human operator to choose the best place to take h ...

Smarter robot arms (w/ video)

Sep 22, 2011

(PhysOrg.com) -- A combination of two algorithms developed at MIT allows autonomous robots to execute tasks much more efficiently — and move more predictably.

Robots could improve everyday life, do chores

Sep 21, 2010

(PhysOrg.com) -- They're mundane, yet daunting tasks: Tidying a messy room. Assembling a bookshelf from a kit of parts. Fetching a hairbrush for someone who can't do it herself. What if a robot could do it ...

Recommended for you

A robot dives into search for Malaysian Airlines flight

Apr 18, 2014

In the hunt for signs of Malaysian Airlines flight MH370—which disappeared on March 8 after deviating for unknown reasons from its scheduled flight path—all eyes today turn to a company that got its start ...

Simplicity is key to co-operative robots

Apr 16, 2014

A way of making hundreds—or even thousands—of tiny robots cluster to carry out tasks without using any memory or processing power has been developed by engineers at the University of Sheffield, UK.

Students turn $250 wheelchair into geo-positioning robot

Apr 16, 2014

Talk about your Craigslist finds! A team of student employees at The University of Alabama in Huntsville's Systems Management and Production Center (SMAP) combined inspiration with innovation to make a $250 ...

Using robots to study evolution

Apr 14, 2014

A new paper by OIST's Neural Computation Unit has demonstrated the usefulness of robots in studying evolution. Published in PLOS ONE, Stefan Elfwing, a researcher in Professor Kenji Doya's Unit, has succes ...

User comments : 1

Adjust slider to filter visible comments by rank

Display comments: newest first

not rated yet Feb 26, 2013
It's a start. But I can not guess how long it will be before a human being leaves an anderoid alone in a room with a small child.

More news stories

Growing app industry has developers racing to keep up

Smartphone application developers say they are challenged by the glut of apps as well as the need to update their software to keep up with evolving phone technology, making creative pricing strategies essential to finding ...

Making graphene in your kitchen

Graphene has been touted as a wonder material—the world's thinnest substance, but super-strong. Now scientists say it is so easy to make you could produce some in your kitchen.