Researchers find that the unexpected is a key to human learning

March 13, 2009

The human brain's sensitivity to unexpected outcomes plays a fundamental role in the ability to adapt and learn new behaviors, according to a new study by a team of psychologists and neuroscientists from the University of Pennsylvania.

Using a computer-based card game and to observe neuronal activity of the brain, the Penn study, published this week in the journal Science, suggests that neurons in the human substantia nigra, or SN, play a central role in reward-based learning, modulating learning based on the discrepancy between the expected and the realized outcome.

"This is the first study to directly record underlying this learning process in humans, confirming the hypothesized role of the basal ganglia, which includes the SN, in models of reinforcement including learning, addiction and other disorders involving reward-seeking behavior," said lead author Kareem Zaghloul, postdoctoral fellow in neurosurgery at Penn's School off Medicine. "By responding to unexpected , these cells encode information that seems to help participants maximize reward in the probabilistic learning task."

Learning, previously studied in animal models, seems to occur when , which drive a larger basal ganglia circuit, are activated in response to unexpected rewards and depressed after the unexpected omission of reward. Put simply, a lucky win seems to be retained better than a probable loss.

Similar to an economic theory, where efficient markets respond to and expected events have no effect, we found that the of the seems to be wired in a similar rational manner -- tuned to learn whenever anything unexpected happens but not when things are predictable," said Michael J. Kahana, senior author and professor of psychology at Penn's School of Arts and Sciences.

Zaghloul worked with Kahana and Gordon Baltuch, associate professor of neurosurgery, in a unique collaboration among departments of psychology, neurosurgery and bioengineering. They used microelectrode recordings obtained during deep brain stimulation surgery of Parkinson's patients to study neuronal activity in the SN, the midbrain structure that plays an important role in movement, as well as reward and addiction. Patients with Parkinson's disease show impaired learning from both positive and negative feedback in cognitive tasks due to the degenerative nature of their disease and the decreased number of dopaminergic neurons.

The recordings were analyzed to determine whether responses were affected by reward expectation. Participants were asked to choose between red and blue decks of cards presented on a computer screen, one of which carried a higher probability of yielding a financial reward than the other. If the draw of a card yielded a reward, a stack of gold coins was displayed along with an audible ring of a cash register and a counter showing accumulated virtual earnings. If the draw did not yield a reward or if no choice was made, the screen turned blank and participants heard a buzz.

"This new way to measure dopaminergic neuron activity has helped us gain a greater understanding of fundamental cognitive activity," said Baltuch, director of the Penn Medicine Center for Functional and Restorative Neurosurgery.

Source: University of Pennsylvania


Rank 5 /5 (4 votes)
Relevant PhysicsForums posts
  • Potential Breakthrough in Seizure Control
    created18 hours ago
  • Popping/Cracked sternum.
    created23 hours ago
  • Which Mental Illness Encompasses This Problem?
    created23 hours ago
  • A question about drug tolerance
    createdMay 23, 2012
  • Poor nutrition leading to overeating?
    createdMay 23, 2012
  • Math and dyslexia?
    createdMay 21, 2012
  • More from Physics Forums - Medical Sciences

More news stories

Keep food safety in mind this memorial day weekend

(HealthDay) -- Picnics, parades and cookouts are as much a part of Memorial Day weekend as tributes to the United States' war veterans.

Medicine & Health / Health

created 3 hours ago | popularity not rated yet | comments 0

Family history of Alzheimer's affects functional connectivity

(HealthDay) -- Cognitively normal individuals with a family history of late-onset Alzheimer's disease (AD) may display lower resting state functional connectivity in the default mode network (DMN) of the brain, ...

Medicine & Health / Alzheimer's disease & dementia

created 12 hours ago | popularity not rated yet | comments 0

Transvaginal mesh op restores pelvic organ prolapse at price

(HealthDay) -- Transvaginal mesh (TVM) procedures are effective for anatomical restoration of pelvic organ prolapse (POP), but patients report a worsening of sexual function following surgery, according to ...

Medicine & Health / Other

created 13 hours ago | popularity not rated yet | comments 0

Travel to high altitudes tied to Crohn's, colitis flare-ups

(HealthDay) -- People with inflammatory bowel disease, which includes Crohn's disease and colitis, may be at increased risk for flare-ups when they fly or travel to high altitudes for skiing or mountain climbing, ...

Medicine & Health / Inflammatory disorders

created 13 hours ago | popularity not rated yet | comments 1 | with audio podcast

Of mice and mental models: Neuroscientific implications of risk-optimized behavior in the mouse

(Medical Xpress) -- Regardless of an organism’s biological complexity, every encephalized animal continuously makes under-informed behavioral choices that can have serious consequences. Despite its ubiquity, ...

Medicine & Health / Neuroscience

created May 25, 2012 | popularity not rated yet | comments 0 | with audio podcast feature


Dell tablet leak: 10.1-inch display, two-battery choice

(Phys.org) -- Headline after headline talks about vendors’ tablets in the wings as likely number-one contenders for the iPad. Such claims have justifiably been taken with a grain of salt, considering ...

Scientist: Evolution debate will soon be history

(AP) -- Richard Leakey predicts skepticism over evolution will soon be history. Not that the avowed atheist has any doubts himself.

SpaceX capsule has 'new car' smell, astronauts say (Update)

SpaceX's Dragon cargo vessel smells like a new car, said astronauts at the International Space Station after opening the hatches Saturday following the spacecraft's landmark mission to the orbiting lab.

SpotterRF debuts Radar Backpack Kit (w/ Video)

(Phys.org) -- SpotterRF has announced a special radar backpack kit designed to enhance situational awareness for soldiers on the ground. The company says its special radar is designed for warfighters as part ...

Thousands of shellfish found dead in Peru

Thousands of crustaceans were found dead off the coast of Lima following the mystery mass death of dolphins and pelicans, the Peruvian Navy said Friday.

Australia hails surprise super-telescope decision

Australia has hailed a surprise decision giving it a role in a radio telescope project aimed at revolutionising astronomy, vowing to draw on its decades of experience in space science.