Computers teach each other Pac-Man (w/ Video)

Apr 01, 2014

Researchers in Washington State University's School of Electrical Engineering and Computer Science have developed a method to allow a computer to give advice and teach skills to another computer in a way that mimics how a real teacher and student might interact.

Matthew E. Taylor, WSU's Allred Distinguished Professor in Artificial Intelligence, reports on his method in the journal Connection Science.

Researchers had the agents – as the are called – act like true student and teacher pairs: student agents struggled to learn Pac-Man and a version of the StarCraft video game. The researchers were able to show that the student agent learned the games and, in fact, surpassed the teacher.

While it may sound like fun and games, helping robots teach each other to play computer games is an important area of research in robotics – and it's not easy. If robots could teach each other tasks, then people wouldn't need to; for instance, a housecleaning robot could teach its replacement the job.

If you're worried about robots taking over the world, though, don't be.

"They're very dumb,'' says Taylor, an expert on robots, agents and helping them to learn.

Even the most advanced robots are easily confused, he says. And when they get confused, they stop working. He says it often takes two or three times longer than he thinks it will to get a robot to work at all.

This video is not supported by your browser at this time.

PacManThe easiest way to successfully teach a robot new skills is to remove the "brains" of the old one and put them in the new one, says Taylor. Problems occur, though, when hardware and software don't work in the new model.

Furthermore, one long-term goal in robotics is for robots to teach skills to humans. But we can't simply insert their hard drives.

In their study, the researchers programmed their teaching agent to focus on action , or telling a student when to act.

As anyone with teenagers knows, the trick is in knowing when the robot should give advice. If it gives no advice, the is not teaching. But if it always gives advice, the student gets annoyed and doesn't learn to outperform the teacher.

"We designed algorithms for advice giving, and we are trying to figure out when our advice makes the biggest difference,'' Taylor says.

He aims to develop a curriculum for the agents that starts with simple work and builds to more complex.

He also recently received an NSF grant to use ideas from dog training to train robotic agents. Eventually, he hopes to develop a better way for people to teach their robotic agents, as well as for robots to teach people.

Explore further: Robots learn from each other on 'Wiki for robots'

add to favorites email to friend print save as pdf

Related Stories

Robots learn from each other on 'Wiki for robots'

Jan 13, 2014

Now it's not just people – robots are also connected by internet thanks to RoboEarth. Next week, after four years of research, scientists at Eindhoven University of Technology (TU/e), Philips and four other ...

Teaching robots linguistic hedges and discourse markers

Feb 11, 2014

(Phys.org) —Before long, robots will be giving us helpful advice, but we don't want them to be snippy about it. Research at Cornell and Carnegie Mellon universities suggests that if they sound a little ...

Research shows cue-giving robots help students learn

May 30, 2012

(Phys.org) -- The well-known fact is that humans can teach robots, but the newer turn in educational circles is all about how robots can teach humans. The stepped-up robots are “animated” and "adaptive" agents that ...

The human touch makes robots defter

Nov 07, 2013

Cornell engineers are helping humans and robots work together to find the best way to do a job, an approach called "coactive learning."

Recommended for you

Forging a photo is easy, but how do you spot a fake?

Nov 21, 2014

Faking photographs is not a new phenomenon. The Cottingley Fairies seemed convincing to some in 1917, just as the images recently broadcast on Russian television, purporting to be satellite images showin ...

Algorithm, not live committee, performs author ranking

Nov 21, 2014

Thousands of authors' works enter the public domain each year, but only a small number of them end up being widely available. So how to choose the ones taking center-stage? And how well can a machine-learning ...

Professor proposes alternative to 'Turing Test'

Nov 19, 2014

(Phys.org) —A Georgia Tech professor is offering an alternative to the celebrated "Turing Test" to determine whether a machine or computer program exhibits human-level intelligence. The Turing Test - originally ...

Image descriptions from computers show gains

Nov 18, 2014

"Man in black shirt is playing guitar." "Man in blue wetsuit is surfing on wave." "Black and white dog jumps over bar." The picture captions were not written by humans but through software capable of accurately ...

Converting data into knowledge

Nov 17, 2014

When a movie-streaming service recommends a new film you might like, sometimes that recommendation becomes a new favorite; other times, the computer's suggestion really misses the mark. Yisong Yue, assistant ...

User comments : 1

Adjust slider to filter visible comments by rank

Display comments: newest first

eric_in_chicago
not rated yet Apr 01, 2014
check out a bot playing the mac asteroids clone maelstrom...

https://www.youtu...SnOUqx-M

it get really wild in the end.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.