Tracking facial features to make driving safer and more comfortable

Nov 16, 2012 by Anne-Muriel Brouet
Credit: EPFL-LTS5 / PSA Peugeot Citroën

(Phys.org)—For those familiar with its language, the face reflects much about an individual's identity and emotional state. EPFL scientists are developing a tool that will be able to use facial information to make the cars of the future safer and more comfortable.

Today's "intelligent" cars, equipped with multiple sensors and algorithms, can react to emergency situations, regulate speed, assist with parking and respond to . But they don't know who's at the wheel or how that driver is feeling. The face is a valuable source of this information, and a project initiated by EPFL's Transportation Center involving EPFL's Signal Processing 5 Laboratory (NTS5) and PSA Peugeot Citroën aims to mine it for use in the automobiles of the future.

Face-related technologies have progressed rapidly in recent years, and are used in many areas. Facial recognition is used in real time to relay the exact position of an individual, and devices indicate the direction in which he or she is looking. Analyzing the movements of the head and eyes can also indicate a state of fatigue or . EPFL's LTS5 and its start-up, nViso, are conducting research into capturing and exploring the wide range of possible scientific, behavioral and commercial applications that the technology offers.

Technological challenges

The scientists had to tackle the challenge of adapting the technology for use in cars. "Our goal is to build the technological base to detect and situate a driver's face at any moment in time," explains NTS5 director Jean-Philippe Thiran. "Using this tool, it will then be possible to build and test various applications such as eye tracking, fatigue detection, , and so on."

"With this study we are trying to make the interface between the car and the driver more intuitive; reading intentions from is a very natural interactive mode," adds Olivier Pajot, PSA Peugeot Citroën's representative on the EPFL campus.

The instrument, developed using a prototyping platform provided by the French car manufacturer, is currently operational, although the research is still far from finished. Vehicles impose a number of specific limitations, beginning with the question of where to place the camera. It cannot obstruct the driver's field of vision. "One of the possible options is to place it behind the steering wheel, which would require a system that's quick enough to recapture the face detection after the arms of the steering wheel interrupt it," explains Thiran. Another issue is adapting to changing lighting conditions, in order to track the driver's face as the car goes into a tunnel, for example, or when driving into a setting sun. And, finally, the tool must perform as well when the driver is facing it as when she turns her head to the side.

Improving performance

"We are currently working on improving the system's performance, particularly by increasing the number of images processed," continues Thiran. "The next step is to test it in realistic conditions. PSA Peugeot Citroën will install the platform on a car and our lab will test the system under various application scenarios."

PSA Peugeot Citroën opened an office in EPFL's Innovation Square in summer 2011, with the goal of collaborating on research and innovation projects. Spearheaded by EPFL's Transportation Center, other projects with EPFL laboratories have been launched, including energy systems, driver assistance systems, human-machine interfaces and predictions for the structure of the automotive market.

Explore further: Comfortable climate indoors with porous glass

add to favorites email to friend print save as pdf

Related Stories

BMW shows hands-free driving on Autobahn (w/ video)

Jan 24, 2012

(PhysOrg.com) -- Move over, Google, or better still, stay off the Autobahn, best not to interfere with the main show, which now stars BMW and its technology feats with self-driving cars. BMW has been drawing ...

BMW and Peugeot team up in hybrids

Feb 28, 2011

The German luxury carmaker BMW and PSA Peugeot Citroen of France announced Monday they would invest 100 million euros ($138 million) in a joint venture to develop hybrid vehicle technology.

Recommended for you

Tesla says decision on battery factory months away

16 hours ago

(AP)—Electric car maker Tesla Motors said Thursday that it is preparing a site near Reno, Nevada, as a possible location for its new battery factory, but is still evaluating other sites.

Comfortable climate indoors with porous glass

Jul 31, 2014

Proper humidity and temperature play a key role in indoor climate. In the future, establishing a comfortable indoor environment may rely on porous glass incorporated into plaster, as this regulates moisture ...

Crash-testing rivets

Jul 31, 2014

Rivets have to reliably hold the chassis of an automobile together – even if there is a crash. Previously, it was difficult to predict with great precision how much load they could tolerate. A more advanced ...

Customized surface inspection

Jul 31, 2014

The quality control of component surfaces is a complex undertaking. Researchers have engineered a high-precision modular inspection system that can be adapted on a customer-specific basis and integrated into ...

User comments : 0