Teaching robots how to move objects

June 13, 2018 by Mary Beth O'leary, Massachusetts Institute of Technology
Doctoral student Maria Bauza has been exploring the notion of uncertainty when robots pick up, grasp, or push an object. “If the robot could touch the object, have a notion of tactile information, and be able to react to that information, it will have much more success," she says. Credit: Tony Pulsone

With the push of a button, months of hard work were about to be put to the test. Sixteen teams of engineers convened in a cavernous exhibit hall in Nagoya, Japan, for the 2017 Amazon Robotics Challenge. The robotic systems they built were tasked with removing items from bins and placing them into boxes. For graduate student Maria Bauza, who served as task-planning lead for the MIT-Princeton Team, the moment was particularly nerve-wracking.

"It was super stressful when the competition started," recalls Bauza. "You just press play and the robot is autonomous. It's going to do whatever you code it for, but you have no control. If something is broken, then that's it."

Robotics has been a major focus for Bauza since her undergraduate career. She studied mathematics and engineering physics at the Polytechnic University of Catalonia in Barcelona. During a year as a visiting student at MIT, Bauza was able to put her interest in computer science and artificial intelligence into practice. "When I came to MIT for that year, I starting applying the tools I had learned in to real problems in robotics," she adds.

Two creative undergraduate projects gave her even more practice in this area. In one project, she hacked the controller of a toy remote control car to make it drive in a straight line. In another, she developed a portable robot that could draw on the blackboard for teachers. The robot was given an image of Mona Lisa and, after going through an algorithm, it drew that image on the blackboard. "That was the first small success in my robotics career," says Bauza.

After graduating with her bachelor's degree in 2016, she joined the Manipulation and Mechanisms Laboratory at MIT (known as MCube Lab) under Assistant Professor Alberto Rodriguez's guidance. "Maria brings together experience in machine learning and a strong background in mathematics, computer science, and mechanics, which makes her a great candidate to grow into a leader in the fields of machine learning and robotics," says Rodriguez.

For her Ph.D. thesis, Bauza is developing machine-learning algorithms and software to improve how robots interact with the world. MCube's multidisciplinary team provides the support needed to pursue this goal.

"In the end, machine learning can't work if you don't have good data," Bauza explains. "Good data comes from good hardware, good sensors, good cameras—so in MCube we all collaborate to make sure the systems we build are powerful enough to be autonomous."

To create these robust autonomous systems, Bauza has been exploring the notion of uncertainty when robots pick up, grasp, or push an object. "If the robot could touch the object, have a notion of tactile information, and be able to react to that information, it will have much more success," explains Bauza.

Improving how robots interact with the world and reason to find the best possible outcome was crucial to the Amazon Robotics Challenge. Bauza built the code that helped the MIT-Princeton Team understand what object it was interacting with, and where to place that object. "Maria was in charge of developing the software for high-level decision making," explains Rodriguez. "She did it without having prior experience in big robotic systems and it worked out fantastic."

Bauza's mind was at ease within a few minutes of 2017 Amazon Robotics Challenge. "After a few objects that you do well, you start to relax," she remembers. "You realize the system is working. By the end it was such a good feeling!"

Bauza and the rest of the MCube team walked away with first place in the "stow task" portion of the challenge. They will continue to work with Amazon on perfecting the technology they developed.

While Bauza tackles the challenge of developing software to help robots interact with their environments, she has her own personal challenge to tackle: surviving winter in Boston. "I'm from the island of Menorca off the coast of Spain, so Boston winters have definitely been an adjustment," she adds. "Every year I buy warmer clothes. But I'm really lucky to be here and be able to collaborate with Professor Rodriguez and the MCube team on developing smart robots that interact with their environment."

Explore further: New robotic system could lend a hand with warehouse sorting and other picking or clearing tasks

Related Stories

Atlas teams head for DARPA Robotics Challenge

November 26, 2013

(Phys.org) —December 20 is a big day for teams competing in the Defense Advanced Research Projects Agency (DARPA) Robotics Challenge. The idea is to promote critical improvements in what robots can do to help out in disaster ...

Deep-learning robot shows grasp of different objects

October 10, 2015

Robot researchers have had much success in getting robots to walk and run; another challenge has persisted for years, and that is getting robots to pick up and hold on to objects successfully. An international workshop on ...

Recommended for you

Permanent, wireless self-charging system using NIR band

October 8, 2018

As wearable devices are emerging, there are numerous studies on wireless charging systems. Here, a KAIST research team has developed a permanent, wireless self-charging platform for low-power wearable electronics by converting ...

Facebook launches AI video-calling device 'Portal'

October 8, 2018

Facebook on Monday launched a range of AI-powered video-calling devices, a strategic revolution for the social network giant which is aiming for a slice of the smart speaker market that is currently dominated by Amazon and ...

Artificial enzymes convert solar energy into hydrogen gas

October 4, 2018

In a new scientific article, researchers at Uppsala University describe how, using a completely new method, they have synthesised an artificial enzyme that functions in the metabolism of living cells. These enzymes can utilize ...

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.