Training computers to classify pictures and videos

At present, computer search and classification of images is made basing on the name of the file, folder or on features as date or size, but the visual information contained was never used for classification purposes. This study conducted by the University of Granada will allow to employ this parameter in the short term for classifying videos according to actions performed by individuals.

The research conducted by Manuel Jesús Marín Jiménez, who is currently working at the University of Cordoba, and coordinated by Professor Nicolás Pérez de la Blanca Capilla, Department of Computing and Artificial Intelligence, University of Granada.

A Specific Pose

Apart from detecting individuals in TV video/film shots, this new technique allows to estimate the position of upper limbs (head, chest, arms and forearms) and the automatic classification of video scenes where people appear in a specific pose. Human actions such as walking, jumping, bending down, etc. can also be detected in video sequences.

As Marín Jiménez explains, currently, there is great interest in important international companies as Microsoft or Google in making computers interpret automatically the visual contents of images and video. "Our work is a contribution towards progress in this demanding challenge" the researcher states.

The results of this research have been presented in a number of international conferences such as the International Conference in Pattern Recognition (2006), and the conference on Computer Vision and Pattern Recognition (2008 and 2009).

Example Images:

- People detection on TV:
http://www.robots.ox.ac.uk/~vgg/software/UpperBody/index.html

- Estimation and recognition of human poses:
http://www.robots.ox.ac.uk/~vgg/research/pose_estimation/index.html

Provided by University of Granada