University of Pennsylvania's PR2 robot learns to read (w/ video)

May 20, 2011 by Katie Gatto weblog

(PhysOrg.com) -- Researchers at the University of Pennsylvania’s GRASP Lab have added new functionality to their Robot PR2. The Robot PR2, which has been given the nickname Graspy, has the ability to read for itself. Graspy can read anything from simple signs to full-length warnings. At this point it has yet to work with longer texts, but in time it may be able to read you a bedtime story.

Graspy is learning to read in the same way that a human toddler would learn. It begins by watching the words in order to recognize the shapes that the words take. Then it attaches a meaning to the shapes, associating the sound of the letter with its look. Then the process of sounding out the words begins. As new and less familiar words are brought into the mix, Graspy will try to match them to known words. Far from the simple word recognition of the current generation of text to speech systems, this system has the capacity to learn.

This video is not supported by your browser at this time.
PR2 robot reading indoor signs and more from the GRASP lab, University of Pennsylvania.

One specific issue to deal with is the font. An average person can encounter hundreds of fonts during their lifetime as a reader. For a human the ability to distinguish the same letter in different fonts is innate, for all but the most ornate or obtuse fonts. A robot is a bit more literal, and requires more processing power and learning time to keep track of 200 different ways to write the letter L or Z.

If you happen to have an ROS platform robot you can download the software for the upgrade from the school for free.

Explore further: Robots learn to take a proper handoff by following digitized human examples

More information: www.ros.org/wiki/literate_pr2

Related Stories

'Word-vision' brain area confirmed

Apr 19, 2006

French neuroscientists have ended a long controversy, confirming a specific area of the human brain plays a causal role in our ability to recognize words.

Recommended for you

The new consoles from Microsoft, Nintendo and Sony

3 hours ago

Microsoft is the last of the three big video game console makers to unveil its latest gaming system. Tuesday's unveiling comes nearly eight years after the Xbox 360 went on sale. It follows last fall's de ...

Microsoft readies new Xbox as entertainment hub

16 hours ago

Microsoft offers a glimpse Tuesday at a new-generation Xbox as videogame consoles evolve into home entertainment centers and adapt to competition from smartphones and tablets.

Finnish start-up launches smartphone to rival giants

May 20, 2013

A group of ex-Nokia employees who quit over the company's decision to abandon the planned MeeGo operating system in favour of Windows presented their own smartphone on Monday, hoping to rival the sector's ...

User comments : 0

More news stories

The new consoles from Microsoft, Nintendo and Sony

Microsoft is the last of the three big video game console makers to unveil its latest gaming system. Tuesday's unveiling comes nearly eight years after the Xbox 360 went on sale. It follows last fall's de ...

Expectations high for next Xbox

It's almost time for a new Xbox. Eight years have passed since Microsoft unveiled the Xbox 360, double the amount of time between the original Xbox debut in 2001 and its high-definition successor's launch ...

If you can remember it, you can remember it wrong

(Medical Xpress)—Native peoples in regions where cameras are uncommon sometimes react with caution when their picture is taken. The fear that something must have been stolen from them to create the photo ...