A new system of stereo cameras detects pedestrians from within the car

Feb 01, 2012
A real of example of how the system detects a pedestrian (red) within a detection area (purple). Credit: C. G. Keller et al.

A team of German researchers, with the help of a lecturer at the University of Alcalá (UAH, Spain), has developed a system that locates pedestrians in front of the vehicle using artificial vision. Soon to be integrated into the top-of-the-range Mercedes vehicles, the device includes two cameras and a unit that process information supplied in real time by all image points.

"The new system can detect pedestrians from within vehicles using visible spectrum cameras and can do so even at night", tells SINC David Fernández Llorca, lecturer at the University of Alcalá (UAH). Along with other scientists from the University of Heidelberg and the Max Planck Institute for Informatics, the researcher was involved in the new development for the prototypes of the company Daimler, which has research centres in Ulm (Germany). The study has been published in the IEEE Transactions on Intelligent Transportation Systems journal.

The newest feature of the device is the use of a dense stereo system. The term 'stereo' refers to the use of two cameras, which are 30 cm apart in a structure below the rear-view mirror. "Human beings are able to make out the distance and depth of objects thanks to our two eyes – the same occurs with ," states the researcher.

Fernández Llorca adds that "the system is called 'dense' because it collects this information from all the points making up each one of the images that the cameras capture." When information is collected from just some points, whether they may be very characteristic (like the edges or corners of an object), the term 'non-dense' is used.

Dense stereo vision allows for a much more precise real time recognition of the surroundings in front of the vehicle (the shape of the road, the presence of pot holes and variations in contact between the vehicle and the road). In fact, pedestrian recognition is improved by a factor of up to 7.5 compared to non-dense systems. Animate objects can be detected in less that 200 milliseconds, like a child who suddenly runs across the road.

The processing unit for executing the algorithm.

The two cameras are connected to a processing unit that executes the artificial vision algorithm. The complex hardware has taken years to develop and is based on FPGA (Field Programmable Gate Array) technology – an electronic system with logic blocks which can be configured on-site using specialised language.

Images can be seen live on a screen with 'heads-up displays' (front transparent screen) or through projections on the inner side of the windscreen. Different response elements can also be added to warn or assist the driver. These include alarms that warn of the presence of a pedestrian, break activation systems and even devices that take control of the wheel to avoid knocking someone down.

"It is possible that we will see this pedestrian recognition system very shortly in the new, top-of-the-range Mercedes models," says Fernández Llorca. But, he recognises that the last word "will depend on business issues" as many decisions need to be made before we can implement it into the production chain.

At the moment, Class C Mercedes vehicles already have single camera systems to detect special objects, such as road signs. Other manufacturers like Toyota have also announced that they will soon launch pedestrian detection stereo systems onto the market.

Explore further: SensaBubble: It's a bubble, but not as we know it (w/ video)

More information: Christoph G. Keller, Markus Enzweiler, Marcus Rohrbach, David Fernández Llorca, Christoph Schnörr, and Dariu M. Gavrila. "The Benefits of Dense Stereo for Pedestrian Detection". IEEE Transactions on Intelligent Transportation Systems 12 (4), December 2011. Doi: 10.1109/TITS.2011.2143410

Provided by FECYT - Spanish Foundation for Science and Technology

5 /5 (2 votes)
add to favorites email to friend print save as pdf

Related Stories

An artificial eye on your driving

Apr 20, 2010

With just a half second's notice, a driver can swerve to avoid a fatal accident or slam on the brakes to miss hitting a child running after a ball. But first, the driver must perceive the danger.

New Volvo pedestrian detection system brakes for you

Feb 25, 2011

(PhysOrg.com) -- Swedish vehicle manufacturer Volvo’s goal is that by 2020 nobody should be killed or seriously injured in a new Volvo and their cars should not seriously injure or kill other road users ...

The car 'learns' to see and understand

Sep 13, 2005

Siemens VDO Automotive presents an ergonomic network of driver assistance systems at the 61st IAA Motor Show in Frankfurt, Germany. As the volume of traffic on the road increases, will help assist drivers by warning them ...

Recommended for you

A smart prosthetic knee with in-vivo diagnoses

Apr 22, 2014

The task was to develop intelligent prosthetic joints that, via sensors, are capable of detecting early failure long before a patient suffers. EPFL researchers have taken up the challenge.

Old tires become material for new and improved roads

Apr 22, 2014

(Phys.org) —Americans generate nearly 300 million scrap tires every year, according to the Environmental Protection Agency (EPA). Historically, these worn tires often end up in landfills or, when illegally ...

Students take clot-buster for a spin

Apr 21, 2014

(Phys.org) —In the hands of some Rice University senior engineering students, a fishing rod is more than what it seems. For them, it's a way to help destroy blood clots that threaten lives.

User comments : 0

More news stories

Is nuclear power the only way to avoid geoengineering?

"I think one can argue that if we were to follow a strong nuclear energy pathway—as well as doing everything else that we can—then we can solve the climate problem without doing geoengineering." So says Tom Wigley, one ...

US urged to drop India WTO case on solar

Environmentalists Wednesday urged the United States to drop plans to haul India to the WTO to open its solar market, saying the action would hurt the fight against climate change.