Tracking facial features to make driving safer and more comfortable

Nov 16, 2012 by Anne-Muriel Brouet
Credit: EPFL-LTS5 / PSA Peugeot Citroën

(—For those familiar with its language, the face reflects much about an individual's identity and emotional state. EPFL scientists are developing a tool that will be able to use facial information to make the cars of the future safer and more comfortable.

Today's "intelligent" cars, equipped with multiple sensors and algorithms, can react to emergency situations, regulate speed, assist with parking and respond to . But they don't know who's at the wheel or how that driver is feeling. The face is a valuable source of this information, and a project initiated by EPFL's Transportation Center involving EPFL's Signal Processing 5 Laboratory (NTS5) and PSA Peugeot Citroën aims to mine it for use in the automobiles of the future.

Face-related technologies have progressed rapidly in recent years, and are used in many areas. Facial recognition is used in real time to relay the exact position of an individual, and devices indicate the direction in which he or she is looking. Analyzing the movements of the head and eyes can also indicate a state of fatigue or . EPFL's LTS5 and its start-up, nViso, are conducting research into capturing and exploring the wide range of possible scientific, behavioral and commercial applications that the technology offers.

Technological challenges

The scientists had to tackle the challenge of adapting the technology for use in cars. "Our goal is to build the technological base to detect and situate a driver's face at any moment in time," explains NTS5 director Jean-Philippe Thiran. "Using this tool, it will then be possible to build and test various applications such as eye tracking, fatigue detection, , and so on."

"With this study we are trying to make the interface between the car and the driver more intuitive; reading intentions from is a very natural interactive mode," adds Olivier Pajot, PSA Peugeot Citroën's representative on the EPFL campus.

The instrument, developed using a prototyping platform provided by the French car manufacturer, is currently operational, although the research is still far from finished. Vehicles impose a number of specific limitations, beginning with the question of where to place the camera. It cannot obstruct the driver's field of vision. "One of the possible options is to place it behind the steering wheel, which would require a system that's quick enough to recapture the face detection after the arms of the steering wheel interrupt it," explains Thiran. Another issue is adapting to changing lighting conditions, in order to track the driver's face as the car goes into a tunnel, for example, or when driving into a setting sun. And, finally, the tool must perform as well when the driver is facing it as when she turns her head to the side.

Improving performance

"We are currently working on improving the system's performance, particularly by increasing the number of images processed," continues Thiran. "The next step is to test it in realistic conditions. PSA Peugeot Citroën will install the platform on a car and our lab will test the system under various application scenarios."

PSA Peugeot Citroën opened an office in EPFL's Innovation Square in summer 2011, with the goal of collaborating on research and innovation projects. Spearheaded by EPFL's Transportation Center, other projects with EPFL laboratories have been launched, including energy systems, driver assistance systems, human-machine interfaces and predictions for the structure of the automotive market.

Explore further: Researcher launches successful tech start-up to help the blind

add to favorites email to friend print save as pdf

Related Stories

BMW shows hands-free driving on Autobahn (w/ video)

Jan 24, 2012

( -- Move over, Google, or better still, stay off the Autobahn, best not to interfere with the main show, which now stars BMW and its technology feats with self-driving cars. BMW has been drawing ...

BMW and Peugeot team up in hybrids

Feb 28, 2011

The German luxury carmaker BMW and PSA Peugeot Citroen of France announced Monday they would invest 100 million euros ($138 million) in a joint venture to develop hybrid vehicle technology.

Recommended for you

Large streams of data warn cars, banks and oil drillers

Apr 16, 2014

Better warning systems that alert motorists to a collision, make banks aware of the risk of losses on bad customers, and tell oil companies about potential problems with new drilling. This is the aim of AMIDST, the EU project ...

User comments : 0

More news stories

Venture investments jump to $9.5B in 1Q

Funding for U.S. startup companies soared 57 percent in the first quarter to a level not seen since 2001, as venture capitalists piled more money into an increasing number of deals, according to a report due out Friday.

White House updating online privacy policy

A new Obama administration privacy policy out Friday explains how the government will gather the user data of online visitors to, mobile apps and social media sites. It also clarifies that ...

Hackathon team's GoogolPlex gives Siri extra powers

( —Four freshmen at the University of Pennsylvania have taken Apple's personal assistant Siri to behave as a graduate-level executive assistant which, when asked, is capable of adjusting the temperature ...

Scientists tether lionfish to Cayman reefs

Research done by U.S. scientists in the Cayman Islands suggests that native predators can be trained to gobble up invasive lionfish that colonize regional reefs and voraciously prey on juvenile marine creatures.

Leeches help save woman's ear after pit bull mauling

(HealthDay)—A pit bull attack in July 2013 left a 19-year-old woman with her left ear ripped from her head, leaving an open wound. After preserving the ear, the surgical team started with a reconnection ...