New software can detect when people text and drive

September 8, 2017, University of Waterloo

Computer algorithms developed by engineering researchers at the University of Waterloo can accurately determine when drivers are texting or engaged in other distracting activities.

The system uses cameras and artificial intelligence (AI) to detect hand movements that deviate from normal driving behaviour and grades or classifies them in terms of possible safety threats.

Fakhri Karray, an electrical and computer engineering professor at Waterloo, said that information could be used to improve road safety by warning or alerting drivers when they are dangerously distracted. And as advanced self-driving features are increasingly added to conventional cars, he said, signs of serious driver distraction could be employed to trigger protective measures.

"The car could actually take over driving if there was imminent danger, even for a short while, in order to avoid crashes," said Karray, a University Research Chair and director of the Centre for Pattern Analysis and Machine Intelligence (CPAMI) at Waterloo.

Algorithms at the heart of the technology were trained using machine-learning techniques to recognize actions such as texting, talking on a cellphone or reaching into the backseat to retrieve something. The seriousness of the action is assessed based on duration and other factors.

That work builds on extensive previous research at CPAMI on the recognition of signs, including frequent blinking, that drivers are in danger of falling asleep at the wheel. Head and face positioning are also important cues of distraction. Ongoing research at the centre now seeks to combine the detection, processing and grading of several different kinds of in a single system.

"It has a huge impact on society," said Karray, citing estimates that distracted are to blame for up to 75 per cent of all traffic accidents worldwide.

Another research project at CPAMI is exploring the use of sensors to measure physiological signals such as eye-blinking rate, pupil size and heart-rate variability to help determine if a driver is paying adequate attention to the road.

Karray's research—done in collaboration with PhD candidates Arief Koesdwiady and Chaojie Ou, and post-doctoral fellow Safaa Bedawi—was recently presented at the 14th International Conference on Image Analysis and Recognition in Montreal.

Explore further: Drivers don't ignore a ringing phone but do ignore the risk

Related Stories

Drivers don't ignore a ringing phone but do ignore the risk

September 7, 2017

Drivers find it difficult to ignore a ringing phone but they do ignore the dangers, with a new QUT study revealing almost 50 per cent believe locating and answering a ringing phone is not as risky as talking and texting.

CQ Researcher examines distracted driving

May 18, 2012

More than 5,000 people die each year in vehicle crashes caused by distracted driving, many who were texting and talking on cellphones behind the wheel, according to the May 4 issue of CQ Researcher (published by CQ Press, ...

Signs of distracted driving—pounding heart, sweaty nose

August 15, 2017

Distracted driving—texting or absent-mindedness—claims thousands of lives a year. Researchers from the University of Houston and the Texas A&M Transportation Institute have produced an extensive dataset examining how ...

Recommended for you

World's biggest battery in Australia to trump Musk's

March 16, 2018

British billionaire businessman Sanjeev Gupta will built the world's biggest battery in South Australia, officials said Friday, overtaking US star entrepreneur Elon Musk's project in the same state last year.

1 in 3 Michigan workers tested opened fake 'phishing' email

March 16, 2018

Michigan auditors who conducted a fake "phishing" attack on 5,000 randomly selected state employees said Friday that nearly one-third opened the email, a quarter clicked on the link and almost one-fifth entered their user ...

Origami-inspired self-locking foldable robotic arm

March 15, 2018

A research team of Seoul National University led by Professor Kyu-Jin Cho has developed an origami-inspired robotic arm that is foldable, self-assembling and also highly-rigid. (The researchers include Suk-Jun Kim, Dae-Young ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.