Stanford computer scientists find Internet security flaw

May 24, 2011 By Melissae Fellet, Stanford University
Postdoctoral researcher Elie Bursztein, left, and John Mitchell, a professor of computer science, with colleagues built a computer program that revealed a security flaw in commercial audio captchas used by major Internet companies.

( -- Researchers at the Stanford Security Laboratory create a computer program to defeat audio captchas on website account registration forms, revealing a design flaw that leaves them vulnerable to automated attacks.

Stanford researchers have found an audible security weakness on the Internet.

If you've ever registered for online access to a website, it's likely you were required as part of the process to correctly read a group of distorted letters and numbers on the screen.

That's a to prove you're a human, not a computer program with malicious intent.

Though computers are good at filling out forms, they struggle to decipher these wavy images crisscrossed with lines, known as captchas (short for Completely Automated Public Turing test to tell Computers and Humans Apart).

But there's a second type of captcha, and it may pose more of a security weakness. These audio captchas, designed to help the visually impaired, require users to accurately listen to a string of spoken letters and/or numbers disguised with .

John Mitchell, a professor of computer science, postdoctoral researcher Elie Bursztein and colleagues built a computer program that could listen to and correctly decipher commercial audio captchas used by Digg, , Microsoft, Yahoo and reCAPTCHA, a company that creates captchas.

The researchers presented their results during a symposium on security and privacy in Oakland, Calif.

The Stanford program, called Decaptcha, successfully decoded Microsoft's audio captcha about 50 percent of the time. It correctly broke only about 1 percent of reCAPTCHA's codes, the most difficult ones of those tested, but even this small success rate is considered trouble for websites such as and that get hundreds of millions of visitors each day.

Imagine a large network of malicious computers creating many on YouTube. This robot network of accounts could highly rate the same video, falsely increasing its popularity and thereby its advertising revenue. "Bot" networks could also swamp email accounts with spam messages.

Decoding sounds

Computers have a tough time attempting to read image captchas, but Mitchell and Bursztein wondered if audio captchas were safe from automated attacks, too.

The researchers taught their program to recognize the unique sound patterns for every letter of the alphabet, as well as numeral digits. Then they challenged their software to decode audio captchas it had never heard before.

The program worked by identifying the sound shapes in the target captcha file, comparing them to those stored in its memory. It worked – the software could to some extent imitate human hearing.

"In the battle of humans versus computers, we lost round one for audio captchas," Bursztein said. "But we have a good idea of what round two should be."

Designing captchas is challenging. The tests must be simple enough for users to answer quickly, yet complicated enough so computers struggle to decipher the patterns. Background noise in an audio captcha can confuse computers, but little is known about the types of noises that trip them up the most.

The researchers generated 4 million audio captchas mixed with white noise, echoes or music, and challenged the program to decode them. After training Decaptcha with some samples, they took it for a test drive.

The program easily defeated captchas mixed with static or repetition, with a 60 to 80 percent success rate, but background music made the task more difficult.

Decaptcha removes the background noise from each audio file, leaving distinctively shaped spikes of energy for each digit or letter in the captcha. The program clearly isolates these spikes from white noise or echoes. But when the captcha contains noises that mimic these energy spikes, Decaptcha is often confused.

Building a program to solve captchas is "an interesting test case for machine learning technology," said Mitchell. "For audio, it's in a realm where machines should do better than humans."

Add meaning

And they do, until they have to think like us. Music lyrics or garbled voices are forms of semantic noise – sounds that carry meaning. Humans can recognize a message mixed with semantic noise, but computers can't distinguish the two clearly. Decaptcha correctly solved only about 1 percent of these captchas.

Of the commercial captchas the team tested, reCAPTCHA was the strongest because it contains background conversation and other semantic noise. Microsoft and Digg have recently changed their audio captchas to use this technology, Bursztein said. But the creation of this latest captcha cracker shows that even the best approach isn't secure enough. "The replacement technology isn't there yet, but we've pinpointed the problem," he said.

Citing data obtained from eBay, the researchers say about 1 percent of people who register at the site use audio captchas. That's enough users to warrant an effort to strengthen this security device.

The researchers suggest programmers tap into our human ability to understand meaning in sounds to improve future captchas. More secure puzzles could include background music or entire words instead of a string of letters. But the team cautions that programmers need to keep the human user in mind. If the is too complicated, legitimate users won't be able to decode it.

Despite efforts to strengthen captchas against computer attacks, they will, like visual captchas, still be vulnerable to crowdsourced attacks by a group of people manually solving captchas for low wages.

Captchas are vital to freedom on the Internet, the researchers say, as the value of many social media sites depends on the assumption that fellow users are humans.

"Captchas are a big inconvenience to people," Mitchell said. "The fact that they're so widely used is evidence of their necessity."

Explore further: Machines can't replicate human image recognition, yet

Related Stories

Strong protection for weak passwords

April 19, 2011

( -- The combination of simple codes and Captchas, which are even more encrypted using a chaotic process, produces effective password protection.

Moving video to 'captcha' robot hackers

December 29, 2009

We see the popular "captcha" security mechanism often ― wavy letters websites ask us to type into a box. It's used by web pages and newsletter sign-up forms to prevent computer robots from hacking into servers and databases. ...

Touch typists could help stop spammers in their tracks

July 15, 2009

( -- Computer scientists at Newcastle University are about to give office workers a perfect excuse to play games: it's all in the name of research. Dr Jeff Yan, together with his PhD student Su-Yang Yu, has created ...

Recommended for you

Researchers find tweeting in cities lower than expected

February 20, 2018

Studying data from Twitter, University of Illinois researchers found that less people tweet per capita from larger cities than in smaller ones, indicating an unexpected trend that has implications in understanding urban pace ...

Augmented reality takes 3-D printing to next level

February 20, 2018

Cornell researchers are taking 3-D printing and 3-D modeling to a new level by using augmented reality (AR) to allow designers to design in physical space while a robotic arm rapidly prints the work.


Adjust slider to filter visible comments by rank

Display comments: newest first

not rated yet May 24, 2011
Any site using Captchas can track which accounts were started with the auditory type. It also can know the percentage of accounts started with them and the percent such accounts for any particular video etc. Thus it can spot abuse patterns and flag up automatically fake accounts.
not rated yet May 24, 2011
The best way is using a captcha where there seems to be no captcha at all for computers. Humans are able to interpret far more from lesser clues. Like this: "tihs cchapta is rdedalbe by hmunas," incorporating the way we read and interpret, and the way we make sense of the sentence as a whole. So design captchas in a way that only a human can decipher instead of trying to beat the machine. Because in the long run the latter is impossible.
5 / 5 (2) May 24, 2011
Mahal I think thats a good idea, but I think a computer program could be easily written to 'decipher' your phrase:
"tihs cchapta is rdedalbe by hmunas' just needs to have the letters rearranged. How many ways can "rdedalbe" be rearranged?

It works because the first and last letters are correct - just typing 'redadalbe' into google gives you the result: "Did you mean, readable?"
What kind of sentence would you construct that humans could decipher than a computer could not?
not rated yet May 24, 2011
For the visually impaired, the two options are audio and tactile. However, tactile would involve sending signals to a device, which would probably be decodable by a computer.

A couple of ideas - perhaps they could use sound-bending techniques to randomly warp the sound of the letter as it is being pronounced. It is like having unlimited accents. Our brains can understand it, but a computer can't match it (yet).

Another idea is to use a simple question and answer type audio captcha. "What is one plus three?" or "Is a dog an animal or fruit?" Until IBM's Watson computer can be made into an affordable machine for the masses, this type of question/answer is easy for us, but beyond a computer.
5 / 5 (2) May 24, 2011
I, for one, welcome our new robot overlords.
not rated yet May 24, 2011
There will come a day when computers will be as good at deciphering images and audio as a human. That day isn't today.
Humans have not lost round 1 as Bursztein so arrogantly states. The 1% success rate breaking the recaptcha audio system clearly show this. There is still plenty of room for improvement with the captcha systems and we can add a problem solving test beside the image/audio captcha.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.