Neural networks that function like the human visual cortex may help realize faster, more reliable pattern recognition

Jul 16, 2014
Neural networks that function like the human visual cortex may help realize faster, more reliable pattern recognition
Artificial neural networks that can more closely mimic the brain’s ability to recognize patterns potentially have broad applications in biometrics, data mining and image analysis. Credit: janulla/iStock/Thinkstock

Despite decades of research, scientists have yet to create an artificial neural network capable of rivaling the speed and accuracy of the human visual cortex. Now, Haizhou Li and Huajin Tang at the A*STAR Institute for Infocomm Research and co-workers in Singapore propose using a spiking neural network (SNN) to solve real-world pattern recognition problems. Artificial neural networks capable of such pattern recognition could have broad applications in biometrics, data mining and image analysis.

Humans are remarkably good at deciphering handwritten text and spotting familiar faces in a crowd. This ability stems from the visual cortex—a dedicated area at the rear of the brain that is used to recognize patterns, such as letters, numbers and facial features. This area contains a complex network of neurons that work in parallel to encode visual information, learn spatiotemporal patterns and classify objects based on prior knowledge or statistical information extracted from patterns.

Like the human visual cortex, SNNs encode visual information in the form of spikes by firing electrical pulses down their 'neurons'. The researchers showed that an SNN employing suitable learning algorithms could recognize handwritten numbers from the Mixed National Institute of Standards and Technology (MNIST) database with a performance comparable to that of support vector machines—the current benchmark for methods.

Their SNN has a feedforward architecture and consists of three types of neurons: encoding, learning and readout neurons. Although the learning neurons are fully capable of discriminating patterns in an unsupervised manner, the researchers sped things up by incorporating supervised learning algorithms in the computation so that the learning could respond to changes faster.

The researchers tested the performance of the SNN by challenging it with images from the MNIST, which contains 60,000 training images and 10,000 testing images of handwritten numbers (ranging from zero to nine). After several training iterations, the SNN could recognize all the numbers in the database. The accuracy of the SNN was high (around 94 per cent) for training images and moderate (around 79 per cent) for testing images. Compared with support vector machines, the encoding and processes of the SNN were fast for training images and moderately fast for testing images.

"We utilized biologically plausible mechanisms to build a cognitive system that is capable of effective and efficient cognitive computations," says Tang. "Together with other related works, this paper paves the way for constructing a general structure of spiking neural systems for cognitive computation."

Explore further: New test chamber making possible research into challenging 'geotechnical' problems

More information: Yu, Q., Tang, H., Tan, K.C. & Li, H. Rapid feedforward computation by temporal encoding and learning with spiking neurons. IEEE Transactions on Neural Networks and Learning Systems 24, 1539–1552 (2013). dx.doi.org/10.1109/TNNLS.2013.2245677

Related Stories

Artificial brains learn to adapt

May 16, 2014

For every thought or behavior, the brain erupts in a riot of activity, as thousands of cells communicate via electrical and chemical signals. Each nerve cell influences others within an intricate, interconnected ...

Mapping objects in the brain

Dec 20, 2013

A brain region that responds to a particular category of objects is found to consist of small clusters of neurons encoding visual features of these objects.

Recommended for you

Revealing faded frescos

4 hours ago

Many details of the wall and ceiling frescos in the cloister of Brandenburg Cathedral have faded: Plaster on which horses once "galloped" appears more or less bare. A hyperspectral camera sees images that remain hidden to ...

Device could detect driver drowsiness, make roads safer

6 hours ago

Drowsy driving injures and kills thousands of people in the United States each year. A device being developed by Vigo Technologies Inc., in collaboration with Wichita State University professor Jibo He and ...

New capability takes sensor fabrication to a new level

Jun 30, 2015

Operators must continually monitor conditions in power plants to assure they are operating safely and efficiently. Researchers on the Sensors and Controls Team at DOE's National Energy Technology Laboratory ...

Smart phones spot tired drivers

Jun 30, 2015

An electronic accelerometer of the kind found in most smart phones that let the device determine its orientation and respond to movement, could also be used to save lives on our roads, according to research ...

User comments : 1

Adjust slider to filter visible comments by rank

Display comments: newest first

a_boeglin67
1 / 5 (1) Jul 16, 2014
I am not so sure about what the author of the article means with accuracy, but as you can see here : http://en.wikiped...atabase, we already did very good on that dataset, and for a long time. Therefore my question is, what is this new approach providing and why is it even worth mentioning ?

Also on the wikipedia article I linked above they give an error rate of 0.56% for SVM ( which I would understand 99.44% accuracy ). 99.44 and 94% isn't exactly what I call comparable in the world of computer vision.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.