NIST, Willow Garage launch first robot 'perception challenge'

Feb 28, 2011 By Mark Bello
This "robot's eye view" shows how some common household objects appear through the vision system being used in the Perception Challenge. The objects are fuzzy because the cameras have limited resolution. However, the images do provide information on depth (distance of every point on an object). The checkered patterns help to define and verify objects in space. Credit: Courtesy Willow Garage

The National Institute of Standards and Technology (NIST) is teaming up with Willow Garage, a Silicon Valley robotics research and design firm, to launch an international “perception challenge” to drive improvements in sensing and perception technologies for next-generation robots.

“Perception is the key bottleneck to robotics. This competition will progressively advance solutions to perception problems, enabling ever wider applications for next-generation adaptive, sensing robots” says Willow Garage senior scientist Gary Bradski.

The competition will debut at the IEEE International Conference on Robotics and Automation (ICRA) 2011, to be held in Shanghai, China, on May 9-13, 2011. It will join three other competitions: updated versions of two other robotics competitions previously developed by NIST—the Virtual Manufacturing Challenge and the Micro-Robot Challenge—and the Modular and Reconfigurable Challenge, a collaborative effort by the National Aeronautics and Space Administration (NASA) and the University of Pennsylvania.

The new competition will measure the performance of current algorithms that process and act on data gathered with cameras and other types of sensing devices, explains NIST computer scientist Tsai Hong. “There are hundreds—maybe even thousands—of algorithms that already have been devised to help robots identify objects and determine their location and orientation,” she says. “But we have no means for comparing and evaluating these perceptual tools and determining whether an existing algorithm will be useful for new types of robots.”

Willow Garage is putting up cash awards for excellent performers. The prize money grows exponentially with performance reflecting the increasing difficulty of each new increment in capability. The top prize is up to $7,000, awarded for successful completion of all tasks within the allotted time.

All contestants will receive a common set of about 35 objects for training and tweaking their algorithms. During the competition, teams will be evaluated on how well their solutions identify and determine the positions of these 35 objects plus an additional set of 15 objects for validation. NIST also will inform contestants of the metrics and methods they are developing for the competition.

Robust perception is a core enabling technology for next-generation robotics being pursued for a variety of applications. Many of these applications will require operating in unstructured and cluttered environments. For anticipated uses ranging from advanced manufacturing to in-home assistance for the elderly, to search-and-rescue operations at disaster sites, robots must be able to identify objects reliably and determine their position accurately.

The practical goals of this and future perception challenges are to determine what solutions already exist for particular robot-performed jobs, and to push the entire field to develop more dynamic and more powerful perception systems critical for next-generation robotics. NIST, a pioneer in developing metrics for evaluating and comparing robots and other automated technologies, has designed a variety of competitions intended to focus research and stimulate innovation in technology areas critical to improving the capabilities of robots.

Techniques and metrics demonstrated in these competitions provide foundations for new standards and test methods for measuring perception system performance. As is true for the other competitions, the perception challenge will grow in difficulty with each passing year.

of Menlo Park, Calif., will provide a common system for testing competitors’ perception algorithms. Visual information and other environmental data will be gathered and communicated by off-the-shelf sensing technologies, and will be evaluated on Willow Garage's Personal Robot 2 (PR2) platform.

Explore further: A robot dives into search for Malaysian Airlines flight

More information: The deadline for entering is April 15, 2011, and final submissions are due May 1, 2011.

For more information on the perception challenge and instructions for entering, go to: opencv.willowgarage.com/wiki/SolutionsInPerceptionChallenge

add to favorites email to friend print save as pdf

Related Stories

Is Your Microrobot Up for the (NIST) Challenge?

Oct 20, 2009

(PhysOrg.com) -- The scientists and engineers who introduced the world to tiny robots demonstrating soccer skills are creating the next level of friendly competition designed to advance microrobotics -- the ...

Researchers develop a robot that folds towels (w/ Video)

Apr 05, 2010

(PhysOrg.com) -- A team from Berkeley's Electrical Engineering and Computer Sciences department has figured out how to get a robot to fold previously unseen towels of different sizes. Their approach solves a key problem in ...

Tests check out rescue robots' life-saving vision

Jun 12, 2008

To save lives, search and rescue robots crawling through the rubble of a collapsed building or surveying a chemical spill area must be capable of beaming back clear, easily interpretable images of what they "see" to operators ...

Robots could improve everyday life, do chores

Sep 21, 2010

(PhysOrg.com) -- They're mundane, yet daunting tasks: Tidying a messy room. Assembling a bookshelf from a kit of parts. Fetching a hairbrush for someone who can't do it herself. What if a robot could do it ...

Recommended for you

A robot dives into search for Malaysian Airlines flight

Apr 18, 2014

In the hunt for signs of Malaysian Airlines flight MH370—which disappeared on March 8 after deviating for unknown reasons from its scheduled flight path—all eyes today turn to a company that got its start ...

Simplicity is key to co-operative robots

Apr 16, 2014

A way of making hundreds—or even thousands—of tiny robots cluster to carry out tasks without using any memory or processing power has been developed by engineers at the University of Sheffield, UK.

Students turn $250 wheelchair into geo-positioning robot

Apr 16, 2014

Talk about your Craigslist finds! A team of student employees at The University of Alabama in Huntsville's Systems Management and Production Center (SMAP) combined inspiration with innovation to make a $250 ...

Using robots to study evolution

Apr 14, 2014

A new paper by OIST's Neural Computation Unit has demonstrated the usefulness of robots in studying evolution. Published in PLOS ONE, Stefan Elfwing, a researcher in Professor Kenji Doya's Unit, has succes ...

User comments : 0

More news stories

Ex-Apple chief plans mobile phone for India

Former Apple chief executive John Sculley, whose marketing skills helped bring the personal computer to desktops worldwide, says he plans to launch a mobile phone in India to exploit its still largely untapped ...

Airbnb rental site raises $450 mn

Online lodging listings website Airbnb inked a $450 million funding deal with investors led by TPG, a source close to the matter said Friday.

Health care site flagged in Heartbleed review

People with accounts on the enrollment website for President Barack Obama's signature health care law are being told to change their passwords following an administration-wide review of the government's vulnerability to the ...

A homemade solar lamp for developing countries

(Phys.org) —The solar lamp developed by the start-up LEDsafari is a more effective, safer, and less expensive form of illumination than the traditional oil lamp currently used by more than one billion people ...

NASA's space station Robonaut finally getting legs

Robonaut, the first out-of-this-world humanoid, is finally getting its space legs. For three years, Robonaut has had to manage from the waist up. This new pair of legs means the experimental robot—now stuck ...

Filipino tests negative for Middle East virus

A Filipino nurse who tested positive for the Middle East virus has been found free of infection in a subsequent examination after he returned home, Philippine health officials said Saturday.

Egypt archaeologists find ancient writer's tomb

Egypt's minister of antiquities says a team of Spanish archaeologists has discovered two tombs in the southern part of the country, one of them belonging to a writer and containing a trove of artifacts including reed pens ...