Deep learning comes full circle

May 7, 2018 by Nathan Collins, Stanford University
Credit: CC0 Public Domain

For years, the people developing artificial intelligence drew inspiration from what was known about the human brain, and it has enjoyed a lot of success as a result. Now, AI is starting to return the favor.

Although not explicitly designed to do so, certain artificial intelligence systems seem to mimic our brains' inner workings more closely than previously thought, suggesting that both AI and our minds have converged on the same approach to solving problems. If so, simply watching AI at work could help researchers unlock some of the deepest mysteries of the .

"There's a real connection there," said Daniel Yamins, assistant professor of psychology. Now, Yamins, who is also a faculty scholar of the Stanford Neurosciences Institute and a member of Stanford Bio-X, and his lab are building on that connection to produce better theories of the brain – how it perceives the world, how it shifts efficiently from one task to the next and perhaps, one day, how it thinks.

A vision problem for AI

Artificial intelligence has been borrowing from the brain since its early days, when computer scientists and psychologists developed algorithms called neural networks that loosely mimicked the brain. Those algorithms were frequently criticized for being biologically implausible – the "neurons" in neural networks were, after all, gross simplifications of the real neurons that make up the brain. But computer scientists didn't care about biological plausibility. They just wanted systems that worked, so they extended neural network models in whatever way made the algorithm best able to carry out certain tasks, culminating in what is now called .

Then came a surprise. In 2012, AI researchers showed that a deep learning neural network could learn to identify objects in pictures as well as a human being, which got neuroscientists wondering: How did deep learning do it?

The same way the brain does, as it turns out. In 2014, Yamins and colleagues showed that a deep learning system that had learned to identify objects in pictures – nearly as well as humans could – did so in a way that closely mimicked the way the brain processes vision. In fact, the computations the deep learning system performed matched activity in the brain's vision-processing circuits substantially better than any other model of those circuits.

Around the same time, other teams made similar observations about parts of the brain's vision– and movement-processing circuits, suggesting that given the same kind of problem, deep learning and the brain had evolved similar ways of coming up with a solution. More recently, Yamins and colleagues have demonstrated similar observations in the brain's auditory system.

On one hand, that's not a big surprise. Although the technical details differ, deep learning's conceptual organization is borrowed directly from what neuroscientists already knew about the organization of neurons in the brain.

But the success of Yamins and colleagues' approach and others like it depends equally as much on another, more subtle choice. Rather than try to get the deep learning system to directly match what the brain does at the level of individual neurons, as many researchers had done, Yamins and colleagues simply gave their deep learning system the same problem: Identify objects in pictures. Only after it had solved that problem did the researchers compare how deep learning and the brain arrived at their solutions – and only then did it become clear that their methods were essentially the same.

"The correspondence between the models and the visual system is not entirely a coincidence, because one directly inspired the other," said Daniel Bear, a postdoctoral researcher in Yamins' group, "but it's still remarkable that it's as good a correspondence as it is."

One likely reason for that, Bear said, is natural selection and evolution. "Basically, object recognition was a very evolutionarily important task" for animals to solve – and solve well, if they wanted to tell the difference between something they could eat and something that could eat them. Perhaps trying to do that as well as humans and other animals do – except with a computer – led researchers to find essentially the same solution.

Seek what the brain seeks

Whatever the underlying reason, insights gleaned from the 2014 study led to what Yamins calls goal-directed models of the brain: Rather than try to model neural activity in the brain directly, instead train artificial intelligence to solve problems the brain needs to solve, then use the resulting AI system as a model of the brain. Since 2014, Yamins and collaborators have been refining the original goal-directed model of the brain's vision circuits and extending the work in new directions, including understanding the neural circuits that process inputs from rodents' whiskers.

In perhaps the most ambitious project, Yamins and postdoctoral fellow Nick Haber are investigating how infants learn about the world around them through play. Their infants – actually relatively simple computer simulations – are motivated only by curiosity. They explore their worlds by moving around and interacting with objects, learning as they go to predict what happens when they hit balls or simply turn their heads. At the same time, the model learns to predict what parts of the world it doesn't understand, then tries to figure those out.

While the computer simulation begins life – so to speak – knowing essentially nothing about the world, it eventually figures out how to categorize different objects and even how to smash two or three of them together. Although direct comparisons with babies' neural activity might be premature, the model could help researchers better understand how infants use play to learn about their environments, Haber said.

On the other end of the spectrum, models inspired by artificial intelligence could help solve a puzzle about the physical layout of the brain, said Eshed Margalit, a graduate student in neurosciences. As the vision circuits in infants' brains develop, they form specific patches – physical clusters of neurons – that respond to different kinds of objects. For example, humans and other primates all form a face patch that is active almost exclusively when they look at faces.

Exactly why the brain forms those patches, Margalit said, isn't clear. The brain doesn't need a face patch to recognize faces, for example. But by building on AI models like Yamins' that already solve object recognition tasks, "we can now try to that spatial structure and ask questions about why the brain is laid out this way and what advantages it might give an organism," Margalit said.

Closing the loop

There are other issues to tackle as well, notably how artificial intelligence systems learn. Right now, AI needs much more training – and much more explicit training – than humans do in order to perform as well on tasks like object recognition, although how humans succeed with so little data remains unclear.

A second issue is how to go beyond models of vision and other sensory systems. "Once you have a sensory impression of the world, you want to make decisions based on it," Yamins said. "We're trying to make models of decision making, learning to make decisions and how you interface between sensory systems, decision making and memory." Yamins is starting to address those ideas with Kevin Feigelis, a graduate student in physics, who is building AI models that can learn to solve many different kinds of problems and switch between tasks as needed, something very few AI systems are able to do.

In the long run, Yamins and the other members of his group said all of those advances could feed into more capable , just as earlier neuroscience research helped foster the development of deep learning. "I think people in artificial intelligence are realizing there are certain very good next goals for cognitively inspired ," Haber said, including systems like his that learn by actively exploring their worlds. "People are playing with these ideas."

Explore further: Dissecting artificial intelligence to better understand the human brain

Related Stories

Neurons have the right shape for deep learning

December 4, 2017

Deep learning has brought about machines that can 'see' the world more like humans can, and recognize language. And while deep learning was inspired by the human brain, the question remains: Does the brain actually learn ...

Recommended for you

Robots as tools and partners in rehabilitation

August 17, 2018

In future decades, the need for effective strategies for medical rehabilitation will increase significantly, because patients' rate of survival after diseases with severe functional deficits, such as a stroke, will increase. ...

Security gaps identified in internet protocol IPsec

August 15, 2018

In collaboration with colleagues from Opole University in Poland, researchers at Horst Görtz Institute for IT Security (HGI) at Ruhr-Universität Bochum (RUB) have demonstrated that the internet protocol IPsec is vulnerable ...

Researchers find flaw in WhatsApp

August 8, 2018

Researchers at Israeli cybersecurity firm said Wednesday they had found a flaw in WhatsApp that could allow hackers to modify and send fake messages in the popular social messaging app.

3 comments

Adjust slider to filter visible comments by rank

Display comments: newest first

Parsec
not rated yet May 08, 2018
The recent discovery that neurons connect with a small collection (less than a handful) of closely associated synapses that are at a distance from the source neuron may be the reason the deep learning takes much longer than that of the brain. The brain simply uses more optimal connections because of its connection topology.

Eikka
not rated yet May 10, 2018
The brain doesn't need a face patch to recognize faces, for example.


It's a solution to the catastrophic forgetting problem, where, if the whole network is involved in a task and the task changes, further training of the network will rapidly overwrite the previously learned skills by changing the network weights.

In order to keep remembering things, the brain has to somehow partition itself. Face recognition is such an important task that it needs extra write protection, so it gets its own set of dedicated neurons.
Eikka
not rated yet May 10, 2018
Catastrophic forgetting is also the main reason why deep learning isn't a perfect analog for the brain in terms of function.

That's because in order for deep learning to be useful in any practical application, it must produce a stable system that doesn't corrupt itself over time - doesn't forget what it has learned or learn to do wrong things by accident. That means the network must be "frozen" once it is trained for a task, and this actually transforms it into the equivalent of a regular computer program - it's no longer capable of intelligence.

The brain isn't frozen in structure but keeps re-adjusting its network continuously through life, so the big question for the deep learners is, how does the brain do it? Is it a question of topology, some property of real neurons, or does the brain actually need to learn to learn first before it can retain any information?

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.