Training computers to classify pictures and videos

Oct 13, 2010

Spanish researchers have developed a new computer technique that allows to "train" computers to interpret the visual contents of a video or picture. This advance will allow to classify automatically pictures basing on whether individuals or specific objects are present in such images. Videos can also be classified according to specific poses.

At present, computer search and classification of images is made basing on the name of the file, folder or on features as date or size, but the contained was never used for classification purposes. This study conducted by the University of Granada will allow to employ this parameter in the short term for classifying videos according to actions performed by individuals.

The research conducted by Manuel Jesús Marín Jiménez, who is currently working at the University of Cordoba, and coordinated by Professor Nicolás Pérez de la Blanca Capilla, Department of Computing and Artificial Intelligence, University of Granada.

A Specific Pose

Apart from detecting individuals in TV /film shots, this new technique allows to estimate the position of upper limbs (head, chest, arms and forearms) and the automatic classification of video scenes where people appear in a specific pose. Human actions such as walking, jumping, bending down, etc. can also be detected in video sequences.

As Marín Jiménez explains, currently, there is great interest in important international companies as Microsoft or Google in making computers interpret automatically the visual contents of images and video. "Our work is a contribution towards progress in this demanding challenge" the researcher states.

The results of this research have been presented in a number of international conferences such as the International Conference in Pattern Recognition (2006), and the conference on Computer Vision and Pattern Recognition (2008 and 2009).

Example Images:

- People detection on TV:
http://www.robots.ox.ac.uk/~vgg/software/UpperBody/index.html

- Estimation and recognition of human poses:
http://www.robots.ox.ac.uk/~vgg/research/pose_estimation/index.html

Explore further: A new kind of data-driven predictive methodology

Provided by University of Granada

5 /5 (1 vote)
add to favorites email to friend print save as pdf

Related Stories

Analyzing audio-visual content

Aug 26, 2010

Filmmakers can identify faults during production with an automatic fault identification and quality assessment system for video sequences. Scientists are also presenting automatic classification for videos at the International ...

Picture this - automatic image categorisation

May 03, 2005

Creating, storing and transmitting visual images has become increasingly easy. Yet the same problem always arises – how to categorise or classify visual images automatically without using external metadata or image thumbnails? ...

Smart computer learns from video

Jun 23, 2010

Swiss researchers have written a computer programme that is able to analyse temporal and spatial patterns of moving objects, and on top of that is capable of learning. This would be a significant aid in traffic ...

Recommended for you

New frontier in error-correcting codes

23 minutes ago

Error-correcting codes are one of the glories of the information age: They're what guarantee the flawless transmission of digital information over the airwaves or through copper wire, even in the presence of the corrupting ...

Five ways the superintelligence revolution might happen

Sep 26, 2014

Biological brains are unlikely to be the final stage of intelligence. Machines already have superhuman strength, speed and stamina – and one day they will have superhuman intelligence. This is of course ...

User comments : 0