Worm uploaded to a computer and trained to balance a pole

February 6, 2018, Vienna University of Technology
The analogue, natural version of C.elegans. Credit: TU Wien

Is it a computer program or a living being? At TU Wien (Vienna), the boundaries have become blurred. The neural system of a nematode was translated into computer code – and then the virtual worm was taught amazing tricks.

It is not much to look at: the nematode C. elegans is about one millimetre in length and is a very simple organism. But for science, it is extremely interesting. C. elegans is the only living being whose neural system has been analysed completely. It can be drawn as a circuit diagram or reproduced by computer software, so that the neural activity of the worm is simulated by a computer program.

Such an artificial C. elegans has now been trained at TU Wien (Vienna) to perform a remarkable trick: The computer worm has learned to balance a pole at the tip of its tail.

C. elegans has to get by with only 300 neurons. But they are enough to make sure that the worm can find its way, eat bacteria and react to certain external stimuli. It can, for example, react to a touch on its body. A reflexive response is triggered and the worm squirms away.

This behaviour is determined by the worm's and the strength of the connections between them. When this simple reflex network is recreated on a computer, the simulated worm reacts in exactly the same way to a virtual stimulation – not because anybody programmed it to do so, but because this kind of behaviour is hard-wired in its neural network.

Credit: TU Wien

"This of such a neural circuit, is very similar to the reaction of a control agent balancing a pole," says Ramin Hasani (Institute of Computer Engineering, TU Wien). This is a typical control problem that can be solved quite well by standard controllers. A pole is fixed on its lower end on a moving object, and it is supposed to stay in a vertical position. Whenever it starts tilting, the lower end has to move slightly to keep the pole from tipping over. Much like the worm has to change its direction whenever it is stimulated by a touch, the pole must be moved whenever it tilts.

Mathias Lechner, Radu Grosu and Ramin Hasani wanted to find out whether the neural system of C. elegans, uploaded to a computer, could solve this problem – without adding any nerve cells, just by tuning the strength of the synaptic connections. This basic idea (tuning the connections between nerve cells) is also the characteristic feature of any natural learning process.

A Program without a Programmer

"With the help of reinforcement learning, a method also known as 'learning based on experiment and reward,' the artificial reflex network was trained and optimized on the computer," Mathias Lechner explains. The team succeeded in teaching the virtual nerve system to balance a pole. "The result is a controller, which can solve a standard technology problem – stabilizing a pole, balanced on its tip. But no human being has written even one line of code for this controller, it just emerged by training a biological nerve system," says Radu Grosu.

The team is going to explore the capabilities of such control circuits further. The project raises the question whether there is a fundamental difference between living systems and computer code. Is machine learning and the activity of our brain the same on a fundamental level? At least we can be pretty sure that the simple nematode C. elegans does not care whether it lives as a worm in the ground or as a virtual worm on a hard drive.

In real life, the worm reacts to touch—and the same neural curcuits can perform tasks in the computer. Credit: TU Wien

Explore further: A brain chemical blamed for mental decline in old age could hold key to its reversal

More information: Worm-level Control through Search-based Reinforcement Learning: docs.google.com/viewer?a=v&pid … Q3YjZhZTZiYWJiNDI5NA

Related Stories

Building a digital life form: OpenWorm, Open Source

May 7, 2013

(Phys.org) —The worm Caenorhabditis elegans is one of the most widely studied creatures. Scientists consider the worm a model organism for exploring animal development including neural development. The reasons are basic; ...

Changing behavior through synaptic engineering

September 8, 2015

Researchers at the University of Massachusetts Medical School are the first to show that it's possible to reverse the behavior of an animal by flipping a switch in neuronal communication. The research, published in PLOS Biology, ...

Recommended for you

A novel approach of improving battery performance

September 18, 2018

New technological developments by UNIST researchers promise to significantly boost the performance of lithium metal batteries in promising research for the next-generation of rechargeable batteries. The study also validates ...

Germany rolls out world's first hydrogen train

September 17, 2018

Germany on Monday rolled out the world's first hydrogen-powered train, signalling the start of a push to challenge the might of polluting diesel trains with costlier but more eco-friendly technology.

Technology streamlines computational science projects

September 15, 2018

Since designing and launching a specialized workflow management system in 2010, a research team from the US Department of Energy's Oak Ridge National Laboratory has continuously updated the technology to help computational ...

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.