Human brain to help computers analyze images

Dec 01, 2010 by Lin Edwards report
Paul Sajda wears an EEG (electroencephalography) cap. Image credit: Eileen Barroso/Columbia University

(PhysOrg.com) -- Brain-computer-interfaces (BCIs) are most often designed to help people (such as those with disabilities) do things they find difficult on their own, but a joint project by Columbia University and a spinoff company, Neuromatters, LLC, is trying to develop a BCI to help computers to rapidly identify images of interest.

The technology, called Cortically Coupled Computer Vision (C3 Vision) takes advantage of the fact that the human can react to images it finds interesting or relevant faster than its owner is consciously aware of, and couples this with the processing power of computers for rapidly identifying those images.

Using the human brain provides the subjective or abstract qualities that computers lack. Dr. Paul Sajda, Professor of Biomedical Engineering at Columbia University, said the brain is good at ranking images according to whether or not the person likes the picture or finds it interesting, which computers cannot do. But computers can process millions of images quickly, which would easily overwhelm the human brain.

The human subject is fitted with an (EEG) cap and shown a sample of images from a large database at a rate of up to 10 images per second. In one experiment the subjects were asked to look for surface to air missiles in satellite images. Every time an interesting or relevant image is shown the in the cap detect electrical activity in the brain, and the signals are captured and decoded by C3Vision. The person may be unaware, or just barely aware of having seen the image.

The computer then ranks the images according to the strength of the electrical activity, and looks for similarities in the images, such as the shapes, textures and colors. In this way the computer gradually learns which images the brain is deeming interesting, and is eventually able to identify them by itself.

Once trained the computer examines images in the much larger database from which the samples were taken. This could contain many millions of images, and the computer selects images similar in visual characteristics to those selected by the human brain.

The project has received financial support from the Defense Advanced Research Projects Agency (DARPA) to develop and test the technology, which is intended for use as in applications such as helping government image analysts to evaluate millions of satellite images for specific characteristics. It may also find application in security applications such as video surveillance, where it would be looking for images of suspicious activity. Neuromatters CEO, Barbara Hanna, said the company aimed to "push the envelope" of computer-brain interfaces to help in areas where there is a problem of information overload.

Other applications envisaged for C3Vision include analysis of consumer preferences in online markets such as fashion, consumer goods, travel products, and even real estate, in a new field known as neuro-marketing. The project is overseen by the technology transfer office at Columbia University, "Columbia Technology Ventures," which acts as a gateway for commercial companies wishing to join forces with the University in developing new technologies.

This video is not supported by your browser at this time.
Neuroscientist Paul Sajda, of Columbia University, taps into the vision system to help computers find meaningful images.


Explore further: Surprising new role for calcium in sensing pain

More information: www.neuromatters.com/focus.html

Related Stories

Using your mood to operate a computer game

May 28, 2009

(PhysOrg.com) -- Brain Computer Interfaces measure electrical signals from the brain and convert them into data that can be used by a computer. You can move a cursor on your screen, for example, simply by ...

Recommended for you

Surprising new role for calcium in sensing pain

5 hours ago

When you accidentally touch a hot oven, you rapidly pull your hand away. Although scientists know the basic neural circuits involved in sensing and responding to such painful stimuli, they are still sorting ...

Neurons in human skin perform advanced calculations

Sep 01, 2014

Neurons in human skin perform advanced calculations, previously believed that only the brain could perform. This is according to a study from Umeå University in Sweden published in the journal Nature Ne ...

Memory in silent neurons

Aug 31, 2014

When we learn, we associate a sensory experience either with other stimuli or with a certain type of behavior. The neurons in the cerebral cortex that transmit the information modify the synaptic connections ...

User comments : 1

Adjust slider to filter visible comments by rank

Display comments: newest first

Sciencebee
not rated yet Dec 01, 2010
I saw a show on either Science or Military channel that talked about this same technique being used to find helicopter landing pads(just a segment of the show).