Training computers to classify pictures and videos

October 13, 2010

Spanish researchers have developed a new computer technique that allows to "train" computers to interpret the visual contents of a video or picture. This advance will allow to classify automatically pictures basing on whether individuals or specific objects are present in such images. Videos can also be classified according to specific poses.

At present, computer search and classification of images is made basing on the name of the file, folder or on features as date or size, but the contained was never used for classification purposes. This study conducted by the University of Granada will allow to employ this parameter in the short term for classifying videos according to actions performed by individuals.

The research conducted by Manuel Jesús Marín Jiménez, who is currently working at the University of Cordoba, and coordinated by Professor Nicolás Pérez de la Blanca Capilla, Department of Computing and Artificial Intelligence, University of Granada.

A Specific Pose

Apart from detecting individuals in TV /film shots, this new technique allows to estimate the position of upper limbs (head, chest, arms and forearms) and the automatic classification of video scenes where people appear in a specific pose. Human actions such as walking, jumping, bending down, etc. can also be detected in video sequences.

As Marín Jiménez explains, currently, there is great interest in important international companies as Microsoft or Google in making computers interpret automatically the visual contents of images and video. "Our work is a contribution towards progress in this demanding challenge" the researcher states.

The results of this research have been presented in a number of international conferences such as the International Conference in Pattern Recognition (2006), and the conference on Computer Vision and Pattern Recognition (2008 and 2009).

Example Images:

- People detection on TV:

- Estimation and recognition of human poses:

Explore further: Picture this - automatic image categorisation

Related Stories

Picture this - automatic image categorisation

May 3, 2005

Creating, storing and transmitting visual images has become increasingly easy. Yet the same problem always arises – how to categorise or classify visual images automatically without using external metadata or image thumbnails? ...

Smart computer learns from video

June 23, 2010

Swiss researchers have written a computer programme that is able to analyse temporal and spatial patterns of moving objects, and on top of that is capable of learning. This would be a significant aid in traffic monitoring.

Analyzing audio-visual content

August 26, 2010

Filmmakers can identify faults during production with an automatic fault identification and quality assessment system for video sequences. Scientists are also presenting automatic classification for videos at the International ...

Recommended for you

AI machine achieves IQ test score of young child

October 6, 2015

Some people might find it enough reason to worry; others, enough reason to be upbeat about what we can achieve in computer science; all await the next chapters in artificial intelligence to see what more a machine can do ...

Dutch create world's largest man-made wave

October 5, 2015

In a country where most people live below sea level, studying the oceans is a matter of survival. Now Dutch scientists have created the world's biggest man-made wave in a bid to prepare for the worst.


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.