An intelligent vehicle that can detect pedestrians at nighttime

May 6, 2014, Carlos III University of Madrid

Researchers at Universidad Carlos III de Madrid (UC3M) have designed a new pedestrian detection system for cars which works in low visibility conditions; the system is made up of infrared cameras which capture body heat.

The new driving-aid system uses images captured by far infrared with two thermal cameras to identify the presence of individuals in their field of vision. The objective is to alert the driver to the presence of pedestrians in the path of the vehicle, and even, in the case of cars with , actually stop the vehicle. "With the model being used in our research, pedestrians up to 40 meters away can be detected, although this distance could be extended if we substitute the lens with one that has greater focus range," explained one of its designers, Daniel Olmeda, from the Intelligent Systems Laboratory (LSI) at UC3M.

The use of this type of sensors provides the driver with information that goes beyond what he himself might perceive, something particularly useful in low visibility conditions such as nighttime driving. "In this situation, the sensitive cameras in the visible spectrum, which are already incorporated into some vehicles, can only be utilized in regions illuminated by the car's headlights. But our system does not require any type of external lighting," the engineer asserted. The infrared range in which it operates corresponds to the emission of heat which allows it to obtain images in conditions of total darkness.

The functioning of the system, explained in a recent scientific article published in the journal Integrated Computer-Aided Engineering, is based on new techniques of image pattern recognition. "The algorithm developed detects pedestrian presence according to certain silhouette features, because we have confirmed that the contour of objects in infrared images have congruent phase features that do not vary with temperature and contrasting," noted professor Olmeda, who is focusing his doctoral thesis on this technology.

Commercial viability

This type of device could be easily installed in a commercial vehicle. In fact, car models already exist that incorporate cameras in the and "integration of a system based on far infrared would not be very different," according to the researchers. The system has been developed and tested on an IVVI 2.0 (Intelligent Vehicle based on Visual Information) at UC3M. Specifically, they use a type of , the non-refrigerated microbolometer, which has gotten the same results as other more costly refrigerated sensors. "Generalized implementation of this type of sensors is viable and its mass production would lower production costs," Olmeda pointed out.

The IVVI 2.0, an actual car that has become a platform for research and experimentation for University faculty and students, also incorporates other artificial vision systems that allow it detect other vehicles and highway lines, read traffic signals, alert the driver with a sound if he starts to fall asleep, and warn of any driving danger. Notwithstanding, the interface for this type of systems still presents a challenge, according to the LSI coordinator, Arturo de la Escalera, professor at the Automated Systems Engineering Department. "It is important to study how to get this information to the driver," because we need to avoid the distractions that an alarm or a screen could present while at the wheel. "We are working to join external perceptions with internal ones so that the system knows if the driver has not seen something, and we only warn him about this obstacle," he elaborated.

This new generation of detectors can also have applications in the field of robotics, according to the scientists. This study is funded by the projects FEDORA from the Comisión Interministerial de Ciencia y Tecnología (CICYT)(Interministerial Science and Technology Research Commission) and by the SEGVAUTO program of the Consejería de Educación, Juventud y Deporte (Council of Youth Sports and New Technologies) of the Autonomous Region of Madrid, which includes researchers from five Spanish university and representatives from the main automobile production factories in operation in Spain.

Explore further: A system that improves the precision of GPS in cities by 90 percent (w/ Video)

More information: "Pedestrian detection in far infrared images." Authors: Daniel Olmeda, Cristiano Premebida, Urbano Nunes, José María Armingol and Arturo de la Escalera. Journal: Integrated Computer-Aided Engineering. Volume: 20. Number: 4. Pages: 347-360. Date of publication: 2013. DOI: 10.3233/ICA-130441

"Pedestrian detection in far infrared images." Thesis of Daniel Olmeda Reino. Directed by José María Armingol Moreno and Arturo de la Escalera Hueso. Automated Systems Engineering UC3M. Defended 17-01-2014. Further information in e-Archives at UC3M:

Related Stories

Volvo researches car tech to see if you are sleepy

March 19, 2014

( —Volvo Cars announced on Monday its work on a driver sensor system that can tell if the driver is alert, distracted, or even nodding off. The idea is to provide a safety system, where, on detection, the car can ...

Weight loss program for infrared cameras

February 3, 2014

Infrared sensors can be employed in a wide range of applications, such as driver assistance systems for vehicles or thermography for buildings. A new camera is providing a test bed for development of new products that use ...

Safer vehicles brake and steer out of harm's way

January 9, 2014

Scientists at Chalmers University in Göteborg, Sweden, are working with a team at car manufacturer Volvo to develop a vehicle control system that can take over steering and breaking when it detects an imminent collision. ...

Recommended for you

Virtually modelling the human brain in a computer

April 19, 2018

Neurons that remain active even after the triggering stimulus has been silenced form the basis of short-term memory. The brain uses rhythmically active neurons to combine larger groups of neurons into functional units. Until ...

'Poker face' stripped away by new-age tech

April 14, 2018

Dolby Laboratories chief scientist Poppy Crum tells of a fast-coming time when technology will see right through people no matter how hard they try to hide their feelings.


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.