Self-learning computer tackles problems beyond the reach of previous systems

October 10, 2016 by Lisa Zyga, feature

The new system that incorporates backpropagation into reservoir computing (“Full”) outperforms other reservoir computing systems (“Reservoir”). Credit: Hermans et al. ©2016 American Physical Society
(—Researchers have developed a neuro-inspired analog computer that has the ability to train itself to become better at whatever tasks it performs. Experimental tests have shown that the new system, which is based on the artificial intelligence algorithm known as "reservoir computing," not only performs better at solving difficult computing tasks than experimental reservoir computers that do not use the new algorithm, but it can also tackle tasks that are so challenging that they are considered beyond the reach of traditional reservoir computing.

The results highlight the potential advantages of self-learning hardware for performing complex tasks, and also support the possibility that self-learning systems—with their potential for high energy-efficiency and ultrafast speeds—may provide an extension to the anticipated end of Moore's law.

The researchers, Michiel Hermans, Piotr Antonik, Marc Haelterman, and Serge Massar at the Université Libre de Bruxelles in Brussels, Belgium, have published a paper on the self-learning hardware in a recent issue of Physical Review Letters.

"On the one hand, over the past decade there has been remarkable progress in artificial intelligence, such as spectacular advances in image recognition, and a computer beating the human Go world champion for the first time, and this progress is largely based on the use of error backpropagation," Antonik told "On the other hand, there is growing interest, both in academia and industry (for example, by IBM and Hewlett Packard) in analog, brain-inspired computing as a possible route to circumvent the end of Moore's law.

"Our work shows that the backpropagation algorithm can, under certain conditions, be implemented using the same hardware used for the analog computing, which could enhance the performance of these hardware systems."

Developed over the past decade, reservoir computing is a neural algorithm that is inspired by the brain's ability to process information. Early studies have shown that reservoir computing can solve complex computing tasks, such as speech and , and do so more efficiently than conventional algorithms. More recently, research has demonstrated that certain experimental implementations, in particular optical implementations, of reservoir computing can perform as well as digital ones.

In more recent years, scientists have shown that the performance of reservoir computing can be improved by combining it with another algorithm called backpropagation. The backpropagation algorithm is at the heart of the recent advances in , such as the milestone earlier this year of a computer beating the human at the game of Go.

The basic idea of backpropagation is that the system performs thousands of iterative calculations that reduce the error a little bit each time, bringing the computed value closer and closer to the optimal value. In the end, the repeated computations teach the system an improved way of computing a solution to a problem.

In 2015, researchers performed the first proof-of-concept experiment in which the backpropagation algorithm in conjunction with the reservoir computing paradigm was tested on a simple task.

In the new paper, the researchers have demonstrated that the algorithm can perform three much more complicated tasks, outperforming reservoir computing systems that do not use backpropagation. The present system is based on a photonic setup (specifically, a delay-coupled electro-optical system) in which the information is coded as the intensity of light pulses propagating in an optical fiber. The key to the demonstration is to physically implement both the reservoir computer and the backpropagation algorithm on the same photonic setup.

The three tasks performed were a speech recognition task (TIMIT), an academic task often used to test reservoir computers (NARMA10), and a complex nonlinear task (VARDEL5) that is considered beyond the reach of traditional reservoir computing. The fact that the new system can tackle this third task suggests that the new approach to self-training has potential for expanding the computing territory of neuromorphic systems.

"We are trying to broaden as much as possible the range of problems to which experimental reservoir computing can be applied," Antonik said. "We are, for instance, writing up a manuscript in which we show that it can be used to generate periodic patterns and emulate chaotic systems."

While the demonstration shows that the new approach is robust against various experimental imperfections, the current set-up is limited by the speed of some of the data processing and data transfer, which the researchers expect can be improved in future work.

"We aim to increase the speed of our experiments," Antonik said. "The present experiment was implemented using a rather slow system, in which the neurons (internal variables) were processed one after the other. We are currently testing photonic systems in which the internal variables are all processed simultaneously—we call this a parallel architecture. This can provide several orders of magnitude of speed-up. Further in the future, we may revisit physical error backpropagation, but in these faster, parallel, systems."

Explore further: Neuromorphic computing mimics important brain feature

More information: Michiel Hermans et al. "Embodiment of Learning in Electro-Optical Signal Processors." Physical Review Letters. DOI: 10.1103/PhysRevLett.117.128301

Related Stories

Neuromorphic computing mimics important brain feature

August 18, 2016

(—When you hear a sound, only some of the neurons in the auditory cortex of your brain are activated. This is because every auditory neuron is tuned to a certain range of sound, so that each neuron is more sensitive ...

Turning to the brain to reboot computing

October 3, 2016

Computation is stuck in a rut. The integrated circuits that powered the past 50 years of technological revolution are reaching their physical limits.

The next step in DNA computing: GPS mapping?

May 6, 2015

Conventional silicon-based computing, which has advanced by leaps and bounds in recent decades, is pushing against its practical limits. DNA computing could help take the digital era to the next level. Scientists are now ...

Recommended for you

CMS gets first result using largest-ever LHC data sample

February 15, 2019

Just under three months after the final proton–proton collisions from the Large Hadron Collider (LHC)'s second run (Run 2), the CMS collaboration has submitted its first paper based on the full LHC dataset collected in ...

Gravitational waves will settle cosmic conundrum

February 14, 2019

Measurements of gravitational waves from approximately 50 binary neutron stars over the next decade will definitively resolve an intense debate about how quickly our universe is expanding, according to findings from an international ...


Adjust slider to filter visible comments by rank

Display comments: newest first

1 / 5 (1) Oct 11, 2016
thanks for sharing this valuable information. self learning of computer tackle problem is very essentially in this new generation world. as a businessman of villa for rent in bahrain , i got a complete information about the computer tackle problems.
1 / 5 (1) Oct 17, 2016
inspired by the brain's ability to process information

Credit is due to the One who created the human brain in the first place.
1 / 5 (2) Oct 17, 2016
Credit is due to the One who created the human brain in the first place.

The One

Neo? Whoa.
5 / 5 (1) Oct 17, 2016
Credit is due to the One who created the human brain in the first place
Yeah. Our brain is an example of a system that has been forced to perform far beyond what it was originally intended to do.

It is oversized, energy-hungry, damage- and defect-prone. It begins to deteriorate soon after adolescence. Few brains function optimally. The majority of people suffer from psychological and neurological deficits, leaving them confused, delirious, emotionally stunted, addiction-prone, etc.

I can't even compose a coherent post here because of the faulty brain your god gave me. But will I find solace in superstition like you do? I'm not that crazy stupid.
Oct 17, 2016
This comment has been removed by a moderator.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.