A smart car that can read brain signals

March 26, 2018 by Clara Marc, Ecole Polytechnique Federale de Lausanne
A smart car that can read brain signals
Credit: Nissan

EPFL and Nissan researchers are able to read a driver's brain signals and send them to a smart vehicle so that it can anticipate the driver's moves and facilitate the driving process. Nissan recently unveiled this brain-to-vehicle (B2V) technology. 

Future cars will be both self-driving and manual. "We wanted to harness technology to enhance ' skills without interfering with the enjoyment of being behind the wheel," explains José del R. Millán, who holds the Defitech Foundation Chair in Brain-Machine Interface (CNBI). As part of a joint project with Nissan researchers based at the CNBI, the team managed to read the that indicate a driver is about to do something – such as accelerate, brake or change lanes – in order to send that information to the . With this advance notice of a few hundreds of milliseconds, the smart vehicle can anticipate the driver's movements and make the ensuing maneuver easier. The car is also equipped with sensors to monitor its environment, which means it can help the driver when traffic conditions are difficult.

An easier and more personalized driving experience

The signals produced in the driver's frontal motor cortex are detected using a sensor-equipped EEG (electroencephalography) headset. They are then sent to the smart vehicle for processing. By combining that data with the information detected by its own sensors, the car can react to the situation at hand. "If you're coming to a red light and getting ready to brake, the car will assist you by starting to brake 200–500 milliseconds before you do. But if you approach a and your brain shows no intention of slowing the car down, the car will warn you that the light is red to make sure you've seen it," says Millán.

We all generate different patterns of brain signals, so the vehicle learns from each driver and customizes its software. It stores each driver's regular routes, as well as their driving habits and style, using this information to more accurately anticipates what each driver might do at any time. The not only makes driving easier, it also creates a more personalized experience, as the car will always be in sync with the driver. Even the car's setting can be transparently adapted to the driver's preferences. For instance, if the driver has adopted a more relaxed driving style, the interface will detect that the selected sports mode is not appropriate and switch the car to a more comfortable setting.

Tech transfer

In 2014, after four years of research, scientists from the CNBI delivered the brain-machine interface to their industry partner Nissan. The carmaker then continued the research through a senior innovation research program with support from the CNBI. The resulting technology was integrated into a prototype, creating the interface that enables the vehicle to communicate with the driver. This prototype was unveiled at the Consumer Electronics Show in Las Vegas in January.

Since 2015, Nissan and the CNBI researchers have been working on further developing this brain-vehicle technology, mainly by adding an eye tracker function. "Our eyes are always moving and observing what's going on around us," says Millán. "But not everything we see is relevant or important. So we are studying ways to detect brain signals that indicate that a certain object or situation has caught our attention and needs to be factored in by the vehicle."

For several years now, Millán's team has been developing scientific knowledge in detecting and using signals to control objects and our environment. They have been focusing on driver-assist technology with Nissan since 2011. In parallel, they have been exploring other applications for their expertise as well, such as helping people with motor disabilities.

Explore further: Top car tech trends from CES 2018

Related Stories

Top car tech trends from CES 2018

January 10, 2018

Artificial intelligence that controls your infotainment screen. A vehicle that can read your brain. Cars that can see around blind corners.

Swiss, Nissan research car that reads the driver's thoughts

September 28, 2011

In the future, thinking about turning left may no longer be just a thought. Japanese auto giant Nissan and a Swiss university are developing cars that scan the driver's thoughts and prepares the vehicle for the next move.

Merge assistant for trucks takes over from the driver

February 15, 2018

Merging on the motorway or changing lanes: this may quite literally become an automatism for truck drivers in the long term. Jan Loof, mechanical engineer at Eindhoven University of Technology, has developed a system that ...

Nankai University team shows car that moves by mind control

December 9, 2015

A car which is powered by your brain has been presented by researchers in China. Yes, it is a mind-controlled vehicle. And it uses nothing but brain power to stay in motion. With special equipment, a driver can go forward, ...

Recommended for you

Google braces for huge EU fine over Android

July 18, 2018

Google prepared Wednesday to be hit with huge EU fine for freezing out rivals of its Android mobile phone system in a ruling that could spark new tensions between Brussels and Washington.

EU set to fine Google billions over Android: sources

July 17, 2018

The EU is set to fine US internet giant Google several billion euros this week for freezing out rivals of its Android mobile phone system, sources said, in a ruling that risks fresh tensions with Washington.

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.