Modeling how we see natural scenes

May 21, 2008

Sophisticated mathematical modeling methods and a “CatCam” that captures feline-centric video of a forest are two elements of a new effort to explain how the brain’s visual circuitry processes real scenes. The new model of the neural responses of a major visual-processing brain region promises to significantly advance understanding of vision.

Valerio Mante and colleagues published a description of their model and its properties in an article in the May 22, 2008, issue of the journal Neuron, published by Cell Press.

The researchers sought to develop the new model because until now, studies of the visual system have used simple stimuli such as dots, bars and gratings.

“Such simple, artificial stimuli present overwhelming advantages in terms of experimental control: their simple visual features can be tailored to isolate and study the function of one or few of the several mechanisms shaping the responses of visual neurons,” wrote the researchers. “Ultimately, however, we need to understand how neurons respond not only to these simple stimuli but also to image sequences that are arbitrarily complex, including those encountered in natural vision. The visual system evolved while viewing complex scenes, and its function may be uniquely adapted to the structure of natural images,” they wrote.

Specifically, the researchers sought to model the neuronal response the lateral geniculate nucleus (LGN) in the thalamus, a brain region that processes raw visual signals received from the retina.

To gather data for the model, they first recorded from LGN neurons in anesthetized cats, as the cats were presented with images of drifting gratings of different sizes, locations and spatial and temporal frequency. They also varied luminance and contrast of the images.

From these data, they created a mathematical model that aimed to describe how these neurons respond and adapt to such complex, changing stimuli. Their ultimate goal was to create a model that would describe not just neural response to the gratings, but to the complexities of natural scenes.

To test their model, they presented cats with two kinds of natural scenes, while recording from LGN neurons. One of these scenes was video recorded from a “CatCam” mounted on the head of a cat as it roamed through a forest. The other was short sequences from the cartoon Disney movie Tarzan.

The researchers found that their model predicted “much of the responses to complex, rapidly changing stimuli… Specifically, the model captures how these responses are affected by changes in luminance and contrast level, overcoming many of the shortcomings of simpler models,” they wrote.

“Even though our model does not capture the operation of all known nonlinear mechanisms, it promises to be a useful tool to understand the computations performed by the early visual system,” they wrote.

Mante and colleagues have provided “a long-needed bridge between the two stimulus worlds,” wrote Garrett Stanley of the Georgia Institute of Technology, in a preview of the paper in the same issue of Neuron.

“By creating an encoding model from a set of experiments involving sinusoidal gratings at different mean luminances and contrasts, and subsequently demonstrating that this model predicts the neuronal response to an entirely different class of visual stimuli based on the visual scene alone, Mante, et al. have made this problem general and provided a powerful description of the encoding properties of the pathway,” wrote Stanley.

Source: Cell Press

Explore further: Dual role: Key cell division proteins also power up mitochondria

add to favorites email to friend print save as pdf

Related Stories

Growing brain is particularly flexible

Jun 22, 2010

Science has long puzzled over why a baby's brain is particularly flexible and why it easily changes. Is it because babies have to learn a lot? A group of researchers from the Bernstein Network Computational ...

Experiment explores innate visual behavior in mice

Oct 10, 2013

When you're a tiny mouse in the wild, spotting aerial predators—like hawks and owls—is essential to your survival. But once you see an owl, how is this visual cue processed into a behavior that helps you ...

Counting small RNA in disease-causing organisms

Jun 18, 2013

Small molecules of RNA (tens to hundreds of nucleotides in length) play a key regulatory role in bacteria. Due to their small size, directly measuring the number of small RNA (sRNA) present in a single bacterium ...

Recommended for you

New pain relief targets discovered

6 hours ago

Scientists have identified new pain relief targets that could be used to provide relief from chemotherapy-induced pain. BBSRC-funded researchers at King's College London made the discovery when researching ...

Building 'smart' cell-based therapies

7 hours ago

A Northwestern University synthetic biology team has created a new technology for modifying human cells to create programmable therapeutics that could travel the body and selectively target cancer and other ...

Proper stem cell function requires hydrogen sulfide

10 hours ago

Stem cells in bone marrow need to produce hydrogen sulfide in order to properly multiply and form bone tissue, according to a new study from the Center for Craniofacial Molecular Biology at the Herman Ostrow School of Dentistry ...

User comments : 0

More news stories

Turning off depression in the brain

Scientists have traced vulnerability to depression-like behaviors in mice to out-of-balance electrical activity inside neurons of the brain's reward circuit and experimentally reversed it – but there's ...

Hackathon team's GoogolPlex gives Siri extra powers

(Phys.org) —Four freshmen at the University of Pennsylvania have taken Apple's personal assistant Siri to behave as a graduate-level executive assistant which, when asked, is capable of adjusting the temperature ...

Better thermal-imaging lens from waste sulfur

Sulfur left over from refining fossil fuels can be transformed into cheap, lightweight, plastic lenses for infrared devices, including night-vision goggles, a University of Arizona-led international team ...