Machines can't replicate human image recognition, yet

September 9, 2009

While computers can replicate many aspects of human behavior, they do not possess our ability to recognize distorted images, according to a team of Penn State researchers.

"Our goal is to seek a better understanding of the fundamental differences between humans and machines and utilize this in developing automated methods for distinguishing humans and robotic programs," said James Z. Wang, associate professor in Penn State's College of Information Sciences and Technology.

Wang, along with Ritendra Datta, a Penn State Ph.D. recipient, and Jia Li, associate professor of statistics at Penn State, explored the difference in human and machine recognition of visual concepts under various image distortions.

The researchers used those differences to design image-based CAPTCHAs (Completely Automated Public Turing Test to Tell Computers and Humans Apart), visual devices used to prevent automated network attacks.

Many e-commerce web sites use CAPTCHAs, which are randomly generated sets of words that a user types in a box provided in order to complete a registration or purchasing process. This is done to verify that the user is human and not a robotic program.

In Wang's study, a demonstration program with an image-based CAPTCHA called IMAGINATION was presented on Both humans and robotic programs were observed using the CAPTCHA.

Although the scope of the human users was limited, the results, presented in the September issue of IEEE Transactions on Information Forensics and Security, proved that robotic programs were not able to recognize distorted images. In other words, a computer recognition program had to rely on an accurate picture, while humans were able to tell what the picture was even though it was distorted.

Wang said he hopes to work with developers in the future to make IMAGINATION a CAPTCHA program that Web sites can use to strengthen the prevention of automated network attacks.

Even though machine recognizability does not exceed human recognizability at this time, Wang says that there is a possibility that it will in the future.

"We are seeing more intelligently designed computer programs that can harness a large volume of online data, much more than a typical human can experience in a lifetime, for knowledge generation and automatic recognition," said Wang. "If certain obstacles, which many believe to be insurmountable, such as scalability and image representation, can be overcome, it is possible that one day machine recognizability can reach that of humans."

Source: Pennsylvania State University (news : web)

Explore further: Online system rates images by aesthetic quality

Related Stories

Online system rates images by aesthetic quality

May 5, 2009

( -- An online photo-rating system developed at Penn State is the first publicly available tool for automatically determining the aesthetic value of an image, according to a Penn State researcher involved with ...

Researchers teach computers how to name images by 'thinking'

November 1, 2006

Penn State researchers have "taught" computers how to interpret images using a vocabulary of up to 330 English words, so that a computer can describe a photograph of two polo players, for instance, as "sport," "people," "horse," ...

New software 'teaches' computers how to identify beauty

June 5, 2006

Beauty is no longer just in the eye of the beholder-computers "taught" to evaluate photographs can match people's aesthetic judgments of "beautiful" or "pretty" more than 70 percent of the time, according to Penn State researchers.

Recommended for you

Microsoft aims at Apple with high-end PCs, 3D software

October 26, 2016

Microsoft launched a new consumer offensive Wednesday, unveiling a high-end computer that challenges the Apple iMac along with an updated Windows operating system that showcases three-dimensional content and "mixed reality."

Making it easier to collaborate on code

October 26, 2016

Git is an open-source system with a polarizing reputation among programmers. It's a powerful tool to help developers track changes to code, but many view it as prohibitively difficult to use.

Dutch unveil giant vacuum to clean outside air

October 25, 2016

Dutch inventors Tuesday unveiled what they called the world's first giant outside air vacuum cleaner—a large purifying system intended to filter out toxic tiny particles from the atmosphere surrounding the machine.


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.