What your face says about your heartbeat

January 29, 2018, Utah State University
USU alumnus Nate Ruben, left, and Dr. Jake Gunther are the inventors of a USU-patented technology that estimates heart rate using a video camera and specialized software. Credit: Matt Jensen/USU

Researchers at Utah State University don't need an Apple Watch or stethoscope to measure your heartbeat. They only need a video camera.

Professor of electrical engineering Jake Gunther and his former student Nate Ruben are the inventors of a USU-patented technology that estimates heart rate using a and specialized software.

"When your heart circulates blood through your arteries and veins, the light absorbed by your skin changes by measurable amounts," says Gunther. "You can't see it with the naked eye, but when our system processes the images from a , the changes are obvious."

Video cameras record images in values of red, green and blue. The green channel provides information that makes heart rate estimation possible.

"Hemoglobin in the blood has an absorption peak for green light," said Gunther. "So when the heart pushes blood into arteries near the skin, more is absorbed and less is reflected. This means we see fewer green values in the images from the camera."

The system processes the color data and computes an average over regions of the image where skin is visible on the face, neck or arms. This contactless monitoring system could revolutionize medical equipment and consumer products including baby monitors and exercise gear. A future version of the inventors' design could even replace hospital tools that monitor blood pressure or .

"The operation of our system is similar to a pulse oximeter," said co-inventor and USU alumnus Nate Ruben. "But instead of looking at the light transmitted through skin tissue, we're looking at the light being reflected from it."

The idea for the heart rate estimation technology came when Ruben and his wife had their first child in 2012. Like most new mothers, Ruben's wife constantly checked on the child as he slept. All those trips to the crib gave Ruben an idea: make a better baby monitor.

At the time, he was experimenting with a similar concept that used webcams to estimate heartbeat. But the technology faced a hurdle: sleeping infants don't hold still, meaning the camera captured competing signals due to motion. Ruben and Gunther, however, say they've developed a way to extract the signals they need.

"We have a technique that allows us to separate those fine details," said Gunther. "We've done this, we've pulled it off."

The inventors are expanding their patented technology with the creation of a new company called Photorithm Inc. Gunther and Ruben are also developing a new system called Smartbeat that uses similar software to detect breathing in a sleeping infant. They say the technology will be a game changer.

Explore further: 'Face time' for the heart diagnoses cardiac disease

Related Stories

'Face time' for the heart diagnoses cardiac disease

August 29, 2014

To the careful observer, a person's face has long provided insight into what is going on beneath the surface. Now, with the assistance of a web camera and software algorithms, the face can also reveal whether or not an individual ...

Medically monitoring premature babies with cameras

April 10, 2017

Researchers at EPFL and CSEM have developed a contactless and wireless camera system to continuously monitor the vital signs of premature babies. This system could replace skin sensors, which cause false alarms nearly 90% ...

How do you feel? Video of your face may tell all

April 6, 2015

Rice University researchers are developing a highly accurate, touch-free system that uses a video camera to monitor patients' vital signs just by looking at their faces. The technique isn't new, but engineering researchers ...

Hold the phone for vital signs

October 6, 2011

An iPhone app that measures the user's heart rate is not only a popular feature with consumers, but it sparked an idea for a Worcester Polytechnic Institute (WPI) researcher who is now turning smart phones, and eventually ...

Recommended for you

Robots as tools and partners in rehabilitation

August 17, 2018

In future decades, the need for effective strategies for medical rehabilitation will increase significantly, because patients' rate of survival after diseases with severe functional deficits, such as a stroke, will increase. ...

Security gaps identified in internet protocol IPsec

August 15, 2018

In collaboration with colleagues from Opole University in Poland, researchers at Horst Görtz Institute for IT Security (HGI) at Ruhr-Universität Bochum (RUB) have demonstrated that the internet protocol IPsec is vulnerable ...

Researchers find flaw in WhatsApp

August 8, 2018

Researchers at Israeli cybersecurity firm said Wednesday they had found a flaw in WhatsApp that could allow hackers to modify and send fake messages in the popular social messaging app.

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.