Neuroscientists reveal how the brain learns to recognize objects

Sep 22, 2010
Neurons in the inferior temporal cortex (IT) confuse the identity of two different objects (in this case, a BMW Z3 and a Volkswagen Beetle) after repeated exposure to the two objects in rapid succession. Image courtesy of James DiCarlo

( -- Understanding how the brain recognizes objects is a central challenge for understanding human vision, and for designing artificial vision systems. (No computer system comes close to human vision.) A new study by MIT neuroscientists suggests that the brain learns to solve the problem of object recognition through its vast experience in the natural world.

Take for example, a dog. It may be sitting nearby or far away or standing in sunshine or shadow. Although each variation in the dog's position, pose or illumination produces a different pattern of light on the retina, we still recognize it as a dog.

One possible way to acquire this ability to recognize an object, despite these variations, is through a simple form of learning. Objects in the real world usually don't suddenly change their identity, so any two patterns appearing on the retina in rapid succession likely arise from the same object. Any difference between the two patterns probably means the object has changed its position rather than having been replaced by another object. So by simply learning to associate images that appear in rapid succession, the brain might learn to recognize objects even if viewed from different angles, distances, or lighting conditions.

To test this idea, called "temporal contiguity," graduate student Nuo Li and associate professor James DiCarlo at MIT's McGovern Institute for Brain Research "tricked" monkeys by exposing them to an altered visual world in which the normal rules of temporal contiguity did not apply. They recorded from individual in a region of the monkey brain called the inferior temporal cortex (IT), where object recognition is thought to happen. IT neurons respond selectively to particular objects; a neuron might, for example, fire more strongly in response to images of a Dalmatian than to pictures a rhinoceros, regardless of its size or position on the .

In the new study, which appears in the Sept. 23 issue of Neuron, monkeys observed an object on a computer screen as the object became larger or smaller, as though it were approaching or receding from view. But in some cases, the researchers replaced an object with another as it changed in size. For example, as a Dalmatian became larger on the screen, it suddenly transformed into a rhinoceros.

"We know that IT neurons are involved in , so our prediction was that these neurons would become confused," explains Li. "By exposing them to this artificial visual experience, we undermined the regularities that we hypothesized teach neurons to recognize the object at multiple sizes."

After a few hours, each IT neuron did indeed become confused. For example, a neuron that preferred a dog over a rhino (regardless of size) began to lose this preference specifically among large dogs and large rhinos (the size at which the temporal contiguity rules had been broken by the researchers). In some cases, the object preferences even started to reverse, and the neuron would begin to prefer large rhinos over large dogs. In other words, the altered visual experience was not merely degrading existing patterns of selectivity but also creating new ones. The new results offered the strongest support yet for the "temporal contiguity" hypothesis of object representation.

"Our monkeys saw only a few hundred examples of these altered visual stimuli during the experiment," says DiCarlo. "If we extrapolate to a lifetime of visual experience, we think this effect is a major contributor to object constancy."

In earlier work, Li and DiCarlo had shown a similar effect when object identities were switched during eye movements. "But we couldn't tell whether that result was peculiar to eye movements - for example, you don't need to observe a large image of a car changing into a small image of the same car," says DiCarlo. "Our new results strongly suggest that this is a general mechanism for learning about object identity across a wide range of real-world conditions."

The researchers did not measure the monkeys' behavior during the new study, so it is not known whether the monkeys themselves become confused by the altered visual experience. But similar effects have been seen in human studies, and it seems likely that the changing pattern of neural activity would lead to changes in perceptual judgments. DiCarlo and colleagues plan to test this in future studies.

Explore further: Long-term effects of battle-related 'blast plus impact' concussive TBI in US military

More information: "Unsupervised natural visual experience rapidly reshapes size invariant object representation in inferior temporal cortex," by Li N, DiCarlo JJ. Neuron. 23 Sept 2010.

Related Stories

Out of sight, out of mind? Not really

Aug 23, 2005

By playing a trick on the brain, neuroscientists at MIT's McGovern Institute for Brain Research have discovered one way that humans naturally recognize objects.

Study: How the Brain Makes a Whole out of Parts

Jan 18, 2006

When a human looks at a number, letter or other shape, neurons in various areas of the brain's visual center respond to different components of that shape, almost instantaneously fitting them together like a puzzle to create ...

Shape encoding may start in the retina

Sep 12, 2007

New evidence from the University of Southern California suggests that there may be dedicated cells in the retina that help compile small bits of information in order to recognize objects. The research was conducted by Ernest ...

Long-distance brain waves focus attention (w/Video)

May 28, 2009

( -- Just as our world buzzes with distractions -- from phone calls to e-mails to tweets -- the neurons in our brain are bombarded with messages. Research has shown that when we pay attention, some of these neurons ...

Recommended for you

Turning off depression in the brain

7 hours ago

Scientists have traced vulnerability to depression-like behaviors in mice to out-of-balance electrical activity inside neurons of the brain's reward circuit and experimentally reversed it – but there's ...

Rapid whole-brain imaging with single cell resolution

7 hours ago

A major challenge of systems biology is understanding how phenomena at the cellular scale correlate with activity at the organism level. A concerted effort has been made especially in the brain, as scientists are aiming to ...

User comments : 0

More news stories

Turning off depression in the brain

Scientists have traced vulnerability to depression-like behaviors in mice to out-of-balance electrical activity inside neurons of the brain's reward circuit and experimentally reversed it – but there's ...

Researchers discover target for treating dengue fever

Two recent papers by a University of Colorado School of Medicine researcher and colleagues may help scientists develop treatments or vaccines for Dengue fever, West Nile virus, Yellow fever, Japanese encephalitis and other ...

Our brains are hardwired for language

A groundbreaking study published in PLOS ONE by Prof. Iris Berent of Northeastern University and researchers at Harvard Medical School shows the brains of individual speakers are sensitive to language univer ...

Better thermal-imaging lens from waste sulfur

Sulfur left over from refining fossil fuels can be transformed into cheap, lightweight, plastic lenses for infrared devices, including night-vision goggles, a University of Arizona-led international team ...

Hackathon team's GoogolPlex gives Siri extra powers

( —Four freshmen at the University of Pennsylvania have taken Apple's personal assistant Siri to behave as a graduate-level executive assistant which, when asked, is capable of adjusting the temperature ...