From handwritten CAPTCHAs to 'smart rooms,' tech solutions start with pattern recognition

Oct 14, 2010

Buy something online, enter your credit card number and mailing address. Simple. Then you come to the box with the CAPTCHA, the Completely Automated Public Turing Test to Tell Computers and Humans Apart. Here, the website attempts to confirm that you're a human, not some robot about to commit a cybercrime. You dutifully copy down the warped, watery-looking letters.

Incorrect. Another captcha appears. You try again. Also incorrect. A third appears. You start rethinking your purchase.

University at Buffalo computer scientist Venu Govindaraju, who pioneered machine recognition of human , believes that this annoying 21st-century problem has a decidedly old-fashioned solution: handwriting.

"Here at UB's Center for Unified Biometrics, we're the only ones who have proposed and thoroughly studied handwritten captchas," says Govindaraju. "Our perspective is that humans are good at reading handwriting, machines are not. It comes naturally to humans. But typically consider handwriting a hopeless case, until someone comes along and shows them that it isn't."

Govindaraju should know. Research he and his UB colleagues conducted in the 1990s helped the U.S. Postal Service establish the first machines that could read handwritten addresses, a feat that many at the time -- especially in industry -- said simply could not be done. In 1996, after years of research, the UB research enabled the USPS to be able to start machine-reading of handwritten addresses, boosting efficiency and saving the agency millions of dollars each year.

Govindaraju believes a similar success can occur with captchas. One of his doctoral students at UB has graduated and was hired by Yahoo! on the basis of his work developing "simulated" handwritten captchas.

"We developed an archive that can automatically generate as many different styles of handwriting as we want," says Govindaraju.

The research is based on pattern recognition, a subfield of machine learning in computer science that is concerned with developing systems based on detecting patterns in data.

Similar issues are being studied by Govindaraju and his UB colleagues in order to develop "smart room" technologies, supported by an HP Labs Innovation Research award.

"Smart rooms" are indoor environments equipped with sensitive, but unobtrusive devices, such as cameras and microphones that can identify and track the movements and gestures of inhabitants for a broad range of applications, from providing supplemental supervision in assisted living facilities for the elderly or disabled, to monitoring office workplaces and retail establishments for security. Eventually, the goal is to extend "smart room" features to larger arenas, such as shopping centers, airports and other transportation centers.

Biometrics that CUBS researchers are studying for "smart room" applications include hand gestures as well as the more common of facial, voice and gait recognition.

"This, too, is all ," Govindaraju says, "but instead of letters, here, we're trying to standardize gestures.

"It's like developing an alphabet of gestures so machines can be programmed to do gesture recognition. The idea is to control objects on a monitor without technology," he says.

Explore further: UT Dallas professor to develop framework to protect computers' cores

Related Stories

Technology would help detect terrorists before they strike

Oct 05, 2007

Are you a terrorist? Airport screeners, customs agents, police officers and members of the military who silently pose that question to people every day, may soon have much more than intuition to depend on to determine the ...

Gesture recognition

Dec 18, 2008

A system that can recognize human gestures could provide a new way for people with physical disabilities to interact with computers. A related system for the able bodied could also be used to make virtual worlds more realistic. ...

Gesture-driven computers

Feb 29, 2008

It isn’t always easy to communicate with a computer. Two Fraunhofer Institutes will be presenting new possibilities of man-machine interaction at CeBIT in Hanover (Germany) on March 4 through 9. They will demonstrate how ...

Recommended for you

User comments : 1

Adjust slider to filter visible comments by rank

Display comments: newest first

Jimbaloid
not rated yet Oct 15, 2010
in the 1990s helped the U.S. Postal Service establish the first machines that could read handwritten addresses


So what good is a hand written captcha, if we've had software that can likely read them for over a decade? I think I've missed something here?!

More news stories

Ex-Apple chief plans mobile phone for India

Former Apple chief executive John Sculley, whose marketing skills helped bring the personal computer to desktops worldwide, says he plans to launch a mobile phone in India to exploit its still largely untapped ...

Airbnb rental site raises $450 mn

Online lodging listings website Airbnb inked a $450 million funding deal with investors led by TPG, a source close to the matter said Friday.

Health care site flagged in Heartbleed review

People with accounts on the enrollment website for President Barack Obama's signature health care law are being told to change their passwords following an administration-wide review of the government's vulnerability to the ...

A homemade solar lamp for developing countries

(Phys.org) —The solar lamp developed by the start-up LEDsafari is a more effective, safer, and less expensive form of illumination than the traditional oil lamp currently used by more than one billion people ...

NASA's space station Robonaut finally getting legs

Robonaut, the first out-of-this-world humanoid, is finally getting its space legs. For three years, Robonaut has had to manage from the waist up. This new pair of legs means the experimental robot—now stuck ...

Filipino tests negative for Middle East virus

A Filipino nurse who tested positive for the Middle East virus has been found free of infection in a subsequent examination after he returned home, Philippine health officials said Saturday.

Egypt archaeologists find ancient writer's tomb

Egypt's minister of antiquities says a team of Spanish archaeologists has discovered two tombs in the southern part of the country, one of them belonging to a writer and containing a trove of artifacts including reed pens ...