Robots in reality

Nov 28, 2011 by Jennifer Chu
Nicholas Roy, an MIT associate professor of aeronautics and astronautics. Photo: Dominick Reuter

Consider the following scenario: A scout surveys a high-rise building that’s been crippled by an earthquake, trapping workers inside. After looking for a point of entry, the scout carefully navigates through a small opening. An officer radios in, “Go look down that corridor and tell me what you see.” The scout steers through smoke and rubble, avoiding obstacles and finding two trapped people, reporting their location via live video. A SWAT team is then sent to lead the workers safely out of the building.

Despite its heroics, though, the scout is impervious to thanks. It just sets its sights on the next mission, like any robot would do.

In the not-too-distant future, such robotics-driven missions will be a routine part of disaster response, predicts Nicholas Roy, an MIT associate professor of aeronautics and astronautics. From Roy’s perspective, robots are ideal for dangerous and covert tasks, such as navigating nuclear disasters or spying on enemy camps. They can be small and resilient — but more importantly, they can save valuable manpower.

The key hurdle to such a scenario is robotic intelligence: Flying through unfamiliar territory while avoiding obstacles is an incredibly complex computational task. Understanding verbal commands in natural language is even trickier.

Both challenges are major objectives in Roy’s research — and with both, he aims to design machine-learning systems that can navigate the noise and uncertainty of the real world. He and a team of students in the Robust Robotics Group, in MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL), are designing robotic systems that “do more things intelligently by themselves,” as he puts it.

For instance, the team is building micro-aerial vehicles (MAVs), about the size of a small briefcase, that navigate independently, without the help of a global positioning system (GPS). Most drones depend on GPS to get around, which limits the areas they can cover. In contrast, Roy and his students are outfitting quadrotors — MAVs propelled by four mini-chopper blades — with sensors and sensor processing, to orient themselves without relying on GPS data.

“You can’t fly indoors or quickly between buildings, or under forest canopies stealthily if you rely on GPS,” Roy says. “But if you put sensors onboard, like laser range finders and cameras, then the vehicle can sense the environment, it can avoid obstacles, it can track its own position relative to landmarks it can see, and it can just do more stuff.”

The group is also building “social robots” that understand natural language. Roy and his students are mathematically modeling the way humans speak to one another, using the models to build robots people can easily interact with. So far, the team has programmed several vehicles to process and respond to natural language, including a robotic forklift that follows commands such as, “Pick up the tire pallet off the truck and set it down.”

Hitting the ground flying

Roy’s first experience with robotics was as an undergraduate at McGill University in Montreal, Canada. During his junior year, the Vancouver native worked for a summer at the university’s Centre for Intelligent Machines, on what he calls “a pretty crazy project.” At the time, in the mid-1990s, the sensors available to track a robot’s position were fairly limited. Often, scientists used wheel odometry — the number of wheel rotations — to estimate a robot’s distance traveled and relative position.

However, the accuracy of this method varied with the surfaces the robot traversed. So Roy and McGill computer scientist Gregory Dudek set about characterizing various surfaces — such as wood, carpet and cement — based on their sounds. The experience inspired Roy to work toward adapting robotics to real-life scenarios.

“My sense was, by working with real data and real robots in the real world, you could get a much clearer sense about what’s hard about intelligence,” Roy says. “I still think that’s true.”

After graduating with a bachelor’s degree in physics and a master’s in computer science, Roy headed south to pursue a PhD at Carnegie Mellon University. There, he worked on two major autonomous robot projects: MINERVA, a talking, interactive museum tour guide; and Pearl, a home health aid for the elderly. Both projects required the robots to interact with humans; MINERVA also needed to navigate a noisy, crowded museum. Roy’s team equipped the robots with a suite of sensors and processing software, enabling them to map their environments and communicate with humans.

When Roy finished his PhD, he took the knowledge he’d gained in ground robotics to the skies. In 2003, he joined MIT’s Department of Aeronautics and Astronautics as an assistant professor. The first project he tackled was a seemingly simple one: to design a robot that can estimate its position and fly through an open window.

“For a ground , this is trivial,” Roy says. “You could reasonably have it as a homework problem at the undergraduate level. But for an air vehicle, there are many things that make it hard.”

It took Roy and his students, Abraham Bachrach, Ruijie He and Sam Prentice, two and a half years to accomplish the task. In 2008, the team demonstrated that its quadrotor, outfitted with sensors and processors, was able to map an unfamiliar environment and navigate through a cardboard cutout. In 2009, Roy entered the vehicle in the International Aerial Robotics Competition (IARC), where it had to navigate an intricate system of hallways, dead ends and openings to locate an LED control panel. The MIT team successfully completed the mission that year, and became the first team in the 19-year history of the IARC to do so its first time. Roy and his students won top honors along with $10,000 in prize money.

Roy is now experimenting with 3-D sensing, equipping quadrotors with stereo cameras to sense and build 3-D maps of an environment. He’s also making inroads on a new challenge: designing intelligent fixed-wing vehicles that can fly over larger distances, such as to track weather patterns or animal migrations.

However, Roy says the advantage of speed is also a challenge: While a quadrotor can hover in place to estimate its location, a small plane cannot. The problem, while significant, is among the many challenges Roy is eager to tackle.

“You feel like you’re enjoying the risk process as much as anything else,” Roy says. “And that’s really important to me, to have fun with the things I’m doing.”


This story is republished courtesy of MIT News (web.mit.edu/newsoffice/), a popular site that covers news about MIT research, innovation and teaching.

Explore further: Socially-assistive robots help kids with autism learn by providing personalized prompts

Related Stories

Flying machines are YouTube sensation

Mar 22, 2011

(PhysOrg.com) -- The latest YouTube sensation isn’t a puppy that dances to Lady Gaga or a kitten that opens beer bottles. By using unmanned aerial vehicles called quadrotors, two Ph.D. candidates at the ...

When robots learn from our mistakes

May 26, 2011

(PhysOrg.com) -- Robots typically acquire new capacities by imitation. Now, EPFL scientists are doing the inverse -- developing machines that can learn more rapidly and outperform humans by starting from failed ...

Robotic dragon, an unlikely teacher

Oct 21, 2011

David DeSteno, an associate professor of psychology at Northeastern, and researchers from the Massachusetts Institute of Technology (MIT) and Harvard University, are examining how social robots can aid preschoolers ...

More than meets the eyeBug

Sep 23, 2011

When you think of robots, you probably think of Arnold Schwarzenegger walking round with part of his metal skull exposed in the Terminator films, or C3PO being the model of politeness in Star Wars. The field ...

Recommended for you

China's Alibaba plans IPO for week of September 8

13 hours ago

Chinese e-commerce giant Alibaba plans to hold its initial public offering on the US stock market the week of September 8, the Wall Street Journal reported Saturday, citing a person familiar with the matter.

Tablet sales slow as PCs find footing

13 hours ago

Tablets won't eclipse personal computers as fast as once thought, according to studies by market tracker International Data Corporation (IDC).

Startups offer banking for smartphone users

13 hours ago

The latest banks are small enough to fit in the palm of your hand. Startups, such as Moven and Simple, offer banking that's designed specifically for smartphones, enabling users to track their spending on the go. Some things ...

FIXD tells car drivers via smartphone what is wrong

Aug 29, 2014

A key source of anxiety while driving solo, when even a bothersome back-seat driver's comments would have made you listen: the "check engine" light is on but you do not feel, smell or see anything wrong. ...

User comments : 7

Adjust slider to filter visible comments by rank

Display comments: newest first

antialias_physorg
not rated yet Nov 28, 2011
It's about time quadcopters were used for this kind of thing. They seem ideally suited as they're independent of ground conditions and highly maneuverable (check out some youtube videos from the MIT lab. They do some crazy things like landing upside down on ceilings or ballisticaly flying through openings just large enough for the copter)

As an aside: SWAT (special weapons and tactics) units do not lead anyone out of a hi-rise after an earthquake.
I think the author got the uses of such scouts (civilian and military) mixed up.
Mounir_Ereuaoiwth
5 / 5 (1) Nov 28, 2011
Consider the following scenario: A scout surveys your house because it can!
Sean_W
5 / 5 (1) Nov 28, 2011
Consider the following scenario: A scout surveys your house because it can!


It won't take nude photos of you through the window. Scout's honor.
antialias_physorg
not rated yet Nov 28, 2011
Finally found the video (I thought it was from MIT but it actually is from the University of Pennsylvania GRASP laboratories)

Flying through narrow spaces (ballistic) and landing on inclined, vertical and upside-down surfaces:
http://www.youtub...0_6o9J10

Flying through thrown hoops:
http://www.youtub...=related

Some slick formation flying and one copter landing on top of another one:
http://www.youtub...=related

On the downside: These copters remind me a lot of Manhacks from HalfLife 2
Birger
not rated yet Nov 28, 2011
Frogstar scout robots....
Nerdyguy
1 / 5 (6) Nov 28, 2011

As an aside: SWAT (special weapons and tactics) units do not lead anyone out of a hi-rise after an earthquake.
I think the author got the uses of such scouts (civilian and military) mixed up.


You're right. No idea if it's related, but I've been seeing this word (SWAT) used more and more the past few years to mean a variety of things outside its original purview.

"SWAT team of CEOs"

"SWAT team of engineers" (one reference to this after an earthquake.

It's taking on a new meaning as any specialized group of elite performers. Go figure.

Thanks for those video links. The quad copters are truly amazing.
Isaacsname
1 / 5 (1) Nov 28, 2011
I'm still seeing great agri-business applications for things like this. Soon enough, soon enough,