Human brain to help computers analyze images

Dec 01, 2010 by Lin Edwards report
Paul Sajda wears an EEG (electroencephalography) cap. Image credit: Eileen Barroso/Columbia University

(PhysOrg.com) -- Brain-computer-interfaces (BCIs) are most often designed to help people (such as those with disabilities) do things they find difficult on their own, but a joint project by Columbia University and a spinoff company, Neuromatters, LLC, is trying to develop a BCI to help computers to rapidly identify images of interest.

The technology, called Cortically Coupled Computer Vision (C3 Vision) takes advantage of the fact that the human can react to images it finds interesting or relevant faster than its owner is consciously aware of, and couples this with the processing power of computers for rapidly identifying those images.

Using the human brain provides the subjective or abstract qualities that computers lack. Dr. Paul Sajda, Professor of Biomedical Engineering at Columbia University, said the brain is good at ranking images according to whether or not the person likes the picture or finds it interesting, which computers cannot do. But computers can process millions of images quickly, which would easily overwhelm the human brain.

The human subject is fitted with an (EEG) cap and shown a sample of images from a large database at a rate of up to 10 images per second. In one experiment the subjects were asked to look for surface to air missiles in satellite images. Every time an interesting or relevant image is shown the in the cap detect electrical activity in the brain, and the signals are captured and decoded by C3Vision. The person may be unaware, or just barely aware of having seen the image.

The computer then ranks the images according to the strength of the electrical activity, and looks for similarities in the images, such as the shapes, textures and colors. In this way the computer gradually learns which images the brain is deeming interesting, and is eventually able to identify them by itself.

Once trained the computer examines images in the much larger database from which the samples were taken. This could contain many millions of images, and the computer selects images similar in visual characteristics to those selected by the human brain.

The project has received financial support from the Defense Advanced Research Projects Agency (DARPA) to develop and test the technology, which is intended for use as in applications such as helping government image analysts to evaluate millions of satellite images for specific characteristics. It may also find application in security applications such as video surveillance, where it would be looking for images of suspicious activity. Neuromatters CEO, Barbara Hanna, said the company aimed to "push the envelope" of computer-brain interfaces to help in areas where there is a problem of information overload.

Other applications envisaged for C3Vision include analysis of consumer preferences in online markets such as fashion, consumer goods, travel products, and even real estate, in a new field known as neuro-marketing. The project is overseen by the technology transfer office at Columbia University, "Columbia Technology Ventures," which acts as a gateway for commercial companies wishing to join forces with the University in developing new technologies.

This video is not supported by your browser at this time.
Neuroscientist Paul Sajda, of Columbia University, taps into the vision system to help computers find meaningful images.


Explore further: Researchers identify protein that predicts post-concussion severity in professional athletes

More information: www.neuromatters.com/focus.html

Related Stories

Using your mood to operate a computer game

May 28, 2009

(PhysOrg.com) -- Brain Computer Interfaces measure electrical signals from the brain and convert them into data that can be used by a computer. You can move a cursor on your screen, for example, simply by ...

Recommended for you

New research supporting stroke rehabilitation

5 hours ago

Using world-leading research methods, the team of Dr David Wright and Prof Paul Holmes, working with Dr Jacqueline Williams from the Victoria University in Melbourne, studied activity in an area of the brain ...

Team finds an off switch for pain

10 hours ago

In research published in the medical journal Brain, Saint Louis University researcher Daniela Salvemini, Ph.D. and colleagues within SLU, the National Institutes of Health (NIH) and other academic institutions have d ...

Brain researchers pinpoint gateway to human memory

12 hours ago

An international team led by researchers of the University of Magdeburg and the DZNE has successfully determined the location, where memories are generated with a level of precision never achieved before. ...

User comments : 1

Adjust slider to filter visible comments by rank

Display comments: newest first

Sciencebee
not rated yet Dec 01, 2010
I saw a show on either Science or Military channel that talked about this same technique being used to find helicopter landing pads(just a segment of the show).

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.