IBM puts supercomputer in 'Jeopardy!'

Feb 08, 2011 By Juli Berwald
Credit: Kansir via flickr

"Let’s finish, ‘Chicks Dig Me’," intones the somewhat monotone, but not unpleasant, voice of Watson, IBM’s new supercomputer built to compete on the game show Jeopardy!

The audience chuckles in response to the machine-like voice and its all-too-human assertion. But fellow contestant Ken Jennings gets the last laugh as he buzzes in and garners $1,000.

This exchange is part of a January 13 practice round for the world’s first man vs. machine game show. Scheduled to air February 14-16, the match pits Watson against the two best Jeopardy! players of all time. Jennings holds the record for the most consecutive games won, at 74. The other contestant, Brad Rutter, has winnings totaling over $3.2 million.

At the contestants’ podium, Watson appears as an atom-like icon sporting the splayed lines of an idea lightbulb. But behind its monitor is some of the most sophisticated computer science ever assembled. A core team of 25 programmers spent four years building Watson, the world’s most advanced question and answer system.

Responding to Jeopardy! questions is tougher than the kind of search that Google does because it requires a single answer, not pages of possibilities. Confounding the problem, said Raymond Mooney, a computer science professor at The University of Texas at Austin, is that the kind of questions that make Jeopardy! interesting are riddled with ambiguity, allusions and puns.

David Ferrucci, program manager of the Watson project, explained that language comes naturally to people, because we think in words and phrases. But computers, at their core zeros and ones, process information mathematically. And there’s no formal mathematics for everyday language.

When Watson receives input, it parses it against a vast database including encyclopedias, textbooks and news archives, along with sources favored by Jeopardy! writers like the complete works of Shakespeare and the Bible.

Watson finds several-hundred candidate answers, which are scored by thousands of algorithms. It then compares the highest score against a threshold. The threshold changes depending on how much risk Watson will accept. “One way to think about it is for every question and answer we have lots of pieces of evidence, then we score each to come up with a single answer,” explained David Gondek, a member of Watson’s algorithms and strategy teams.

Watson runs on 3,000 cores simultaneously, an example of the aptly named “massively parallel computing.” Such hefty computational rigging reveals its most preferred answer in seconds. A typical PC requires about two hours for the same process.

This fall Watson played 55 sparring matches against Tournament of Champions winners. The training taught Watson that some algorithms are more trustworthy than others. The computer awards these algorithms higher scores.

Mooney, who attended several sparring matches but did not contribute to the Watson project, said he was skeptical that a machine could compete on Jeopardy! but became convinced after seeing Watson in action. “They’ve done a great job of putting together a lot of existing artificial intelligence technology into a very complicated system that actually works on this problem.”

Watson receives its input in text form -- it doesn’t use speech recognition software -- at the same moment the contestants see it. Host Alex Trebek then reads the question out loud. When he’s done speaking, a light signals that the buzzers are open. Watson receives an electronic signal at the same moment and will buzz in only if it has an answer with a high enough score in time.

Part of the fun of watching Watson is the answer panel that shows viewers the machine’s top three candidate answers and their scores, along with the threshold, which is lower when Watson trails in a game and increases when it’s ahead.

“It’s something that the team is watching closely during the game, too,“ said Gondek.

If the January 13 match is any indication, Watson has both the speed and accuracy to put up a fight. While neither man nor machine missed a single question during the 5-minute parry, Watson finished the round with $4,400, ahead of Jennings with $3,400 and Rutter with $1,200.

A representative from IBM reported that no changes were made to Watson following the January 13 round, “The system is now locked and has not been refined since the practice match.”

As of this writing, the all-human poll on the IBM website gives a high score to Watson: 53 percent of the respondents think the next Jeopardy! Champion will be a machine.

Explore further: Government wants to make cars talk to each other (Update)

Provided by Inside Science News Service

5 /5 (1 vote)
add to favorites email to friend print save as pdf

Related Stories

'Jeopardy!' to pit humans against IBM machine

Dec 14, 2010

(AP) -- The game show "Jeopardy!" will pit man versus machine this winter in a competition that will show how successful scientists are in creating a computer that can mimic human intelligence.

IBM computer taking on 'Jeopardy!' champs for $1M

Jan 13, 2011

It's the size of 10 refrigerators, and it swallows encyclopedias whole, but an IBM computer was lacking one thing it needed to battle the greatest champions from the "Jeopardy!" quiz show.

Computer could make 2 'Jeopardy!' champs deep blue

Jan 13, 2011

(AP) -- The clue: It's the size of 10 refrigerators, has access to the equivalent of 200 million pages of information and knows how to answer in the form of a question. The correct response: "What is the ...

Jefferson Lab cluster tops 100 teraflops

Oct 15, 2010

The fastest computer system in Hampton Roads has booted up with more than 100 Teraflops of processing power. Located at the Department of Energy's Thomas Jefferson National Accelerator Facility, the cluster computer system ...

Recommended for you

Facebook awards 'Internet Defense Prize'

15 minutes ago

Facebook awarded a $50,000 Internet Defense Prize to a pair of German researchers with a seemingly viable approach to detecting vulnerabilities in Web applications.

HP revenue inches up after years of decline

9 hours ago

Hewlett-Packard on Wednesday reported that its quarterly revenue rose for the first time in three years, nudged by improved computer sales everywhere except Russia and China.

Giant tablets aimed at families

10 hours ago

Costing a little more than an iPad but standing more than twice as tall, a new pair of giant tablets wants families to share cozier group experiences with technology.

Restaurants experimenting with pay-in-advance tickets

12 hours ago

With restaurant patrons increasingly jumping on the Internet to make reservations, some high-end eateries here and across the country are adding a new tech wrinkle: having their clientele pay for their meal in advance using ...

User comments : 0