Neural networks that function like the human visual cortex may help realize faster, more reliable pattern recognition

July 16, 2014, Agency for Science, Technology and Research (A*STAR), Singapore
Neural networks that function like the human visual cortex may help realize faster, more reliable pattern recognition
Artificial neural networks that can more closely mimic the brain’s ability to recognize patterns potentially have broad applications in biometrics, data mining and image analysis. Credit: janulla/iStock/Thinkstock

Despite decades of research, scientists have yet to create an artificial neural network capable of rivaling the speed and accuracy of the human visual cortex. Now, Haizhou Li and Huajin Tang at the A*STAR Institute for Infocomm Research and co-workers in Singapore propose using a spiking neural network (SNN) to solve real-world pattern recognition problems. Artificial neural networks capable of such pattern recognition could have broad applications in biometrics, data mining and image analysis.

Humans are remarkably good at deciphering handwritten text and spotting familiar faces in a crowd. This ability stems from the visual cortex—a dedicated area at the rear of the brain that is used to recognize patterns, such as letters, numbers and facial features. This area contains a complex network of neurons that work in parallel to encode visual information, learn spatiotemporal patterns and classify objects based on prior knowledge or statistical information extracted from patterns.

Like the human visual cortex, SNNs encode visual information in the form of spikes by firing electrical pulses down their 'neurons'. The researchers showed that an SNN employing suitable learning algorithms could recognize handwritten numbers from the Mixed National Institute of Standards and Technology (MNIST) database with a performance comparable to that of support vector machines—the current benchmark for methods.

Their SNN has a feedforward architecture and consists of three types of neurons: encoding, learning and readout neurons. Although the learning neurons are fully capable of discriminating patterns in an unsupervised manner, the researchers sped things up by incorporating supervised learning algorithms in the computation so that the learning could respond to changes faster.

The researchers tested the performance of the SNN by challenging it with images from the MNIST, which contains 60,000 training images and 10,000 testing images of handwritten numbers (ranging from zero to nine). After several training iterations, the SNN could recognize all the numbers in the database. The accuracy of the SNN was high (around 94 per cent) for training images and moderate (around 79 per cent) for testing images. Compared with support vector machines, the encoding and processes of the SNN were fast for training images and moderately fast for testing images.

"We utilized biologically plausible mechanisms to build a cognitive system that is capable of effective and efficient cognitive computations," says Tang. "Together with other related works, this paper paves the way for constructing a general structure of spiking neural systems for cognitive computation."

Explore further: Artificial brains learn to adapt

More information: Yu, Q., Tang, H., Tan, K.C. & Li, H. Rapid feedforward computation by temporal encoding and learning with spiking neurons. IEEE Transactions on Neural Networks and Learning Systems 24, 1539–1552 (2013).

Related Stories

Artificial brains learn to adapt

May 16, 2014

For every thought or behavior, the brain erupts in a riot of activity, as thousands of cells communicate via electrical and chemical signals. Each nerve cell influences others within an intricate, interconnected neural network. ...

Mapping objects in the brain

December 20, 2013

A brain region that responds to a particular category of objects is found to consist of small clusters of neurons encoding visual features of these objects.

Recommended for you

EPA adviser is promoting harmful ideas, scientists say

March 22, 2019

The Trump administration's reliance on industry-funded environmental specialists is again coming under fire, this time by researchers who say that Louis Anthony "Tony" Cox Jr., who leads a key Environmental Protection Agency ...

Coffee-based colloids for direct solar absorption

March 22, 2019

Solar energy is one of the most promising resources to help reduce fossil fuel consumption and mitigate greenhouse gas emissions to power a sustainable future. Devices presently in use to convert solar energy into thermal ...

1 comment

Adjust slider to filter visible comments by rank

Display comments: newest first

1 / 5 (1) Jul 16, 2014
I am not so sure about what the author of the article means with accuracy, but as you can see here : http://en.wikiped...atabase, we already did very good on that dataset, and for a long time. Therefore my question is, what is this new approach providing and why is it even worth mentioning ?

Also on the wikipedia article I linked above they give an error rate of 0.56% for SVM ( which I would understand 99.44% accuracy ). 99.44 and 94% isn't exactly what I call comparable in the world of computer vision.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.