IBM puts supercomputer in 'Jeopardy!'

Feb 08, 2011 By Juli Berwald
Credit: Kansir via flickr

"Let’s finish, ‘Chicks Dig Me’," intones the somewhat monotone, but not unpleasant, voice of Watson, IBM’s new supercomputer built to compete on the game show Jeopardy!

The audience chuckles in response to the machine-like voice and its all-too-human assertion. But fellow contestant Ken Jennings gets the last laugh as he buzzes in and garners $1,000.

This exchange is part of a January 13 practice round for the world’s first man vs. machine game show. Scheduled to air February 14-16, the match pits Watson against the two best Jeopardy! players of all time. Jennings holds the record for the most consecutive games won, at 74. The other contestant, Brad Rutter, has winnings totaling over $3.2 million.

At the contestants’ podium, Watson appears as an atom-like icon sporting the splayed lines of an idea lightbulb. But behind its monitor is some of the most sophisticated computer science ever assembled. A core team of 25 programmers spent four years building Watson, the world’s most advanced question and answer system.

Responding to Jeopardy! questions is tougher than the kind of search that Google does because it requires a single answer, not pages of possibilities. Confounding the problem, said Raymond Mooney, a computer science professor at The University of Texas at Austin, is that the kind of questions that make Jeopardy! interesting are riddled with ambiguity, allusions and puns.

David Ferrucci, program manager of the Watson project, explained that language comes naturally to people, because we think in words and phrases. But computers, at their core zeros and ones, process information mathematically. And there’s no formal mathematics for everyday language.

When Watson receives input, it parses it against a vast database including encyclopedias, textbooks and news archives, along with sources favored by Jeopardy! writers like the complete works of Shakespeare and the Bible.

Watson finds several-hundred candidate answers, which are scored by thousands of algorithms. It then compares the highest score against a threshold. The threshold changes depending on how much risk Watson will accept. “One way to think about it is for every question and answer we have lots of pieces of evidence, then we score each to come up with a single answer,” explained David Gondek, a member of Watson’s algorithms and strategy teams.

Watson runs on 3,000 cores simultaneously, an example of the aptly named “massively parallel computing.” Such hefty computational rigging reveals its most preferred answer in seconds. A typical PC requires about two hours for the same process.

This fall Watson played 55 sparring matches against Tournament of Champions winners. The training taught Watson that some algorithms are more trustworthy than others. The computer awards these algorithms higher scores.

Mooney, who attended several sparring matches but did not contribute to the Watson project, said he was skeptical that a machine could compete on Jeopardy! but became convinced after seeing Watson in action. “They’ve done a great job of putting together a lot of existing artificial intelligence technology into a very complicated system that actually works on this problem.”

Watson receives its input in text form -- it doesn’t use speech recognition software -- at the same moment the contestants see it. Host Alex Trebek then reads the question out loud. When he’s done speaking, a light signals that the buzzers are open. Watson receives an electronic signal at the same moment and will buzz in only if it has an answer with a high enough score in time.

Part of the fun of watching Watson is the answer panel that shows viewers the machine’s top three candidate answers and their scores, along with the threshold, which is lower when Watson trails in a game and increases when it’s ahead.

“It’s something that the team is watching closely during the game, too,“ said Gondek.

If the January 13 match is any indication, Watson has both the speed and accuracy to put up a fight. While neither man nor machine missed a single question during the 5-minute parry, Watson finished the round with $4,400, ahead of Jennings with $3,400 and Rutter with $1,200.

A representative from IBM reported that no changes were made to Watson following the January 13 round, “The system is now locked and has not been refined since the practice match.”

As of this writing, the all-human poll on the IBM website gives a high score to Watson: 53 percent of the respondents think the next Jeopardy! Champion will be a machine.

Explore further: For Google's self-driving cars, learning to deal with the bizarre is essential

Provided by Inside Science News Service

5 /5 (1 vote)
add to favorites email to friend print save as pdf

Related Stories

'Jeopardy!' to pit humans against IBM machine

Dec 14, 2010

(AP) -- The game show "Jeopardy!" will pit man versus machine this winter in a competition that will show how successful scientists are in creating a computer that can mimic human intelligence.

IBM computer taking on 'Jeopardy!' champs for $1M

Jan 13, 2011

It's the size of 10 refrigerators, and it swallows encyclopedias whole, but an IBM computer was lacking one thing it needed to battle the greatest champions from the "Jeopardy!" quiz show.

Computer could make 2 'Jeopardy!' champs deep blue

Jan 13, 2011

(AP) -- The clue: It's the size of 10 refrigerators, has access to the equivalent of 200 million pages of information and knows how to answer in the form of a question. The correct response: "What is the ...

Jefferson Lab cluster tops 100 teraflops

Oct 15, 2010

The fastest computer system in Hampton Roads has booted up with more than 100 Teraflops of processing power. Located at the Department of Energy's Thomas Jefferson National Accelerator Facility, the cluster computer system ...

Recommended for you

Bluetooth may be the key to your future smart home

16 hours ago

If you've ever considered trying to turn your house into a smart home, you've likely found the prospect expensive or technologically intimidating. That situation could soon change, thanks in part to an old ...

Self-driving cars could be the answer to congested roads

Nov 24, 2014

If cars with drivers still suffer under gridlock conditions on roads, how will driverless cars fare any better? With greater computerisation and network awareness, driverless cars may be the answer to growing ...

User comments : 0

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.