Tracking facial features to make driving safer and more comfortable

November 16, 2012 by Anne-Muriel Brouet
Credit: EPFL-LTS5 / PSA Peugeot Citroën

(—For those familiar with its language, the face reflects much about an individual's identity and emotional state. EPFL scientists are developing a tool that will be able to use facial information to make the cars of the future safer and more comfortable.

Today's "intelligent" cars, equipped with multiple sensors and algorithms, can react to emergency situations, regulate speed, assist with parking and respond to . But they don't know who's at the wheel or how that driver is feeling. The face is a valuable source of this information, and a project initiated by EPFL's Transportation Center involving EPFL's Signal Processing 5 Laboratory (NTS5) and PSA Peugeot Citroën aims to mine it for use in the automobiles of the future.

Face-related technologies have progressed rapidly in recent years, and are used in many areas. Facial recognition is used in real time to relay the exact position of an individual, and devices indicate the direction in which he or she is looking. Analyzing the movements of the head and eyes can also indicate a state of fatigue or . EPFL's LTS5 and its start-up, nViso, are conducting research into capturing and exploring the wide range of possible scientific, behavioral and commercial applications that the technology offers.

Technological challenges

The scientists had to tackle the challenge of adapting the technology for use in cars. "Our goal is to build the technological base to detect and situate a driver's face at any moment in time," explains NTS5 director Jean-Philippe Thiran. "Using this tool, it will then be possible to build and test various applications such as eye tracking, fatigue detection, , and so on."

"With this study we are trying to make the interface between the car and the driver more intuitive; reading intentions from is a very natural interactive mode," adds Olivier Pajot, PSA Peugeot Citroën's representative on the EPFL campus.

The instrument, developed using a prototyping platform provided by the French car manufacturer, is currently operational, although the research is still far from finished. Vehicles impose a number of specific limitations, beginning with the question of where to place the camera. It cannot obstruct the driver's field of vision. "One of the possible options is to place it behind the steering wheel, which would require a system that's quick enough to recapture the face detection after the arms of the steering wheel interrupt it," explains Thiran. Another issue is adapting to changing lighting conditions, in order to track the driver's face as the car goes into a tunnel, for example, or when driving into a setting sun. And, finally, the tool must perform as well when the driver is facing it as when she turns her head to the side.

Improving performance

"We are currently working on improving the system's performance, particularly by increasing the number of images processed," continues Thiran. "The next step is to test it in realistic conditions. PSA Peugeot Citroën will install the platform on a car and our lab will test the system under various application scenarios."

PSA Peugeot Citroën opened an office in EPFL's Innovation Square in summer 2011, with the goal of collaborating on research and innovation projects. Spearheaded by EPFL's Transportation Center, other projects with EPFL laboratories have been launched, including energy systems, driver assistance systems, human-machine interfaces and predictions for the structure of the automotive market.

Explore further: Swiss, Nissan research car that reads the driver's thoughts

Related Stories

Swiss, Nissan research car that reads the driver's thoughts

September 28, 2011

In the future, thinking about turning left may no longer be just a thought. Japanese auto giant Nissan and a Swiss university are developing cars that scan the driver's thoughts and prepares the vehicle for the next move.

BMW shows hands-free driving on Autobahn (w/ video)

January 24, 2012

( -- Move over, Google, or better still, stay off the Autobahn, best not to interfere with the main show, which now stars BMW and its technology feats with self-driving cars. BMW has been drawing press interest ...

BMW and Peugeot team up in hybrids

February 28, 2011

The German luxury carmaker BMW and PSA Peugeot Citroen of France announced Monday they would invest 100 million euros ($138 million) in a joint venture to develop hybrid vehicle technology.

Recommended for you

Volumetric 3-D printing builds on need for speed

December 11, 2017

While additive manufacturing (AM), commonly known as 3-D printing, is enabling engineers and scientists to build parts in configurations and designs never before possible, the impact of the technology has been limited by ...

Tech titans ramp up tools to win over children

December 10, 2017

From smartphone messaging tailored for tikes to computers for classrooms, technology titans are weaving their way into childhoods to form lifelong bonds, raising hackles of advocacy groups.


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.