Researchers find that the unexpected is a key to human learning

Mar 13, 2009

The human brain's sensitivity to unexpected outcomes plays a fundamental role in the ability to adapt and learn new behaviors, according to a new study by a team of psychologists and neuroscientists from the University of Pennsylvania.

Using a computer-based card game and to observe neuronal activity of the brain, the Penn study, published this week in the journal Science, suggests that neurons in the human substantia nigra, or SN, play a central role in reward-based learning, modulating learning based on the discrepancy between the expected and the realized outcome.

"This is the first study to directly record underlying this learning process in humans, confirming the hypothesized role of the basal ganglia, which includes the SN, in models of reinforcement including learning, addiction and other disorders involving reward-seeking behavior," said lead author Kareem Zaghloul, postdoctoral fellow in neurosurgery at Penn's School off Medicine. "By responding to unexpected , these cells encode information that seems to help participants maximize reward in the probabilistic learning task."

Learning, previously studied in animal models, seems to occur when , which drive a larger basal ganglia circuit, are activated in response to unexpected rewards and depressed after the unexpected omission of reward. Put simply, a lucky win seems to be retained better than a probable loss.

Similar to an economic theory, where efficient markets respond to and expected events have no effect, we found that the of the seems to be wired in a similar rational manner -- tuned to learn whenever anything unexpected happens but not when things are predictable," said Michael J. Kahana, senior author and professor of psychology at Penn's School of Arts and Sciences.

Zaghloul worked with Kahana and Gordon Baltuch, associate professor of neurosurgery, in a unique collaboration among departments of psychology, neurosurgery and bioengineering. They used microelectrode recordings obtained during deep brain stimulation surgery of Parkinson's patients to study neuronal activity in the SN, the midbrain structure that plays an important role in movement, as well as reward and addiction. Patients with Parkinson's disease show impaired learning from both positive and negative feedback in cognitive tasks due to the degenerative nature of their disease and the decreased number of dopaminergic neurons.

The recordings were analyzed to determine whether responses were affected by reward expectation. Participants were asked to choose between red and blue decks of cards presented on a computer screen, one of which carried a higher probability of yielding a financial reward than the other. If the draw of a card yielded a reward, a stack of gold coins was displayed along with an audible ring of a cash register and a counter showing accumulated virtual earnings. If the draw did not yield a reward or if no choice was made, the screen turned blank and participants heard a buzz.

"This new way to measure dopaminergic neuron activity has helped us gain a greater understanding of fundamental cognitive activity," said Baltuch, director of the Penn Medicine Center for Functional and Restorative Neurosurgery.

Source: University of Pennsylvania

Explore further: Self-regulation intervention boosts school readiness of at-risk children, study shows

add to favorites email to friend print save as pdf

Related Stories

Picower research finds unexpected activity in visual cortex

Mar 16, 2006

For years, neural activity in the brain's visual cortex was thought to have only one job: to create visual perceptions. A new study by researchers at MIT's Picower Institute for Learning and Memory shows that visual cortical ...

The influence of the menstrual cycle on the female brain

Feb 26, 2007

What influence does the variation in estrogen level have on the activation of the female brain? Using functional Magnetic Resonance Imaging, Jean-Claude Dreher, a researcher at the Cognitive Neuroscience Center (CNRS/Université ...

Brain activity encodes reward magnitude and delay during choice

Jul 09, 2008

Good things may come to those who wait, but research has proven that humans and animals actually prefer an immediate rather than a delayed reward. Now, a study published by Cell Press in the July 10 issue of the journal Neuron reveal ...

Measuring the brain's 'rich switch'

Apr 04, 2007

Economists have postulated that people’s perception of the value of financial gains decreases as they become richer, but scientists have not really been able to measure this change in “marginal utility” in the laboratory… ...

Recommended for you

Brains transform remote threats into anxiety

Nov 21, 2014

Modern life can feel defined by low-level anxiety swirling through society. Continual reports about terrorism and war. A struggle to stay on top of family finances and hold onto jobs. An onslaught of news ...

Mental disorders due to permanent stress

Nov 21, 2014

Activated through permanent stress, immune cells will have a damaging effect on and cause changes to the brain. This may result in mental disorders. The effects of permanent stress on the immune system are studied by the ...

Could there be a bright side to depression?

Nov 21, 2014

(Medical Xpress)—A group of researchers studying the roots of depression has developed a test that leads them closer to the idea that depression may actually be an adaptation meant to help people cope with ...

User comments : 0

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.