Voice-stress software is put to the test

Aug 22, 2012 by Nancy Owano report
(a) the setup of the interview room. (b) the setup of data collection. Image from "StressSense: Detecting Stress in Unconstrained Acoustic Environments using Smartphones", Hong Lu et al.

(Phys.org) -- Computer scientists working in a range of departments, from pervasive computing to mobile computing to sensors, will converge in Pittsburgh for the 14th International Conference on Ubiquitous Computing (Ubicomp 2012) on September 5 through 8. They will learn more there about a team’s software that can recognize stress from vocal patterns. The researchers wanted to see if they could successfully train a system to pick up stress through a person's voice. Their paper, “StressSense: Detecting Stress in Unconstrained Acoustic Environments using Smartphones,” authored by Hong Lu, Mashfiqui Rabbi, Gokul T. Chittaranjan, Denise Frauendorfer, Marianne Schmid Mast, Andrew T. Campbell, Daniel Gatica-Perez, and Tanzeem Choudhury, details their success.

“We propose StressSense for unobtrusively recognizing from human voice using smartphones,” say the authors, and they believe they can demonstrate that their StressSense classifier “can robustly identify stress across multiple individuals in diverse acoustic environments.”

Their system is trained first to recognize someone's unstressed voice. StressSense compares this recording to its preprogrammed knowledge of stress-caused physiological changes, such as faster speech and clipped frequency spectrum.

The study authors, including Hong Lu of Intel in Santa Clara, California, found the prototype's stress-recognition accuracy to be 81 per cent indoors and 76 per cent outdoors.

Baseline voice rates for a group of people were gathered. According to their system, the person is told first to relax and read a three-minute passage from a book into the phone. Participants were subsequently placed in stressful job interviews to test the system. The study group totaled 14. Thirteen participants were undergraduate students in fields such as geology, psychology, biology, and law. One participant was a PhD student. Audio data was collected using Nexus One phones at 8kHz 16 bit PCM using a custom Android program that runs in the background, according to the paper.

The researchers next plan to design, deploy, and evaluate a StressSense Android app. The inevitable question is what good will it do to be told by one’s own smartphone to chill out. The team is confident that the app carries real and practical benefits. Lu said the software has the potential to raise user awareness of stressful events and to help cope.

The interest in voice analysis to recognize stress is not new. The study authors point to pioneering work in 1968 when amplitude, fundamental frequency, and spectrograms were analyzed for speech under task-induced stress . They also noted a body of research on stress detection from speech centered around the Speech Under Simulated and Actual Stress (SUSAS) dataset.

“Evidence from experiments with SUSAS suggests that pitch plays a prominent role in stress. Other important features are those using energy, spectral characteristics of the glottal pulse, and phonetic variations (speaking rate) and spectral slope.”

As for their own study findings, the team pointed out four contributions of their paper. They experimentally show that 1) stress from human voice can be detected using smartphones in indoor and outdoor conversational data; that 2) a universal stress model can be adapted to specific individual users; 3) a stress model can be adapted to unseen environments, lowering the cost of training stress models for different scenarios; and 4) the proposed stress classification pipeline can run in real-time on off-the-shelf Android smartphones.

Explore further: Hackathon team's GoogolPlex gives Siri extra powers

More information: publications.idiap.ch/downloads/papers/2012/Lu_UBICOMP_2012.pdf

Related Stories

Stress changes how people make decisions: study

Feb 28, 2012

(Medical Xpress) -- Trying to make a big decision while you’re also preparing for a scary presentation? You might want to hold off on that. Feeling stressed changes how people weigh risk and reward. A new article published ...

Changing environment affects stress level in mice

Jul 09, 2012

(Medical Xpress) -- The negative impact of stress on health is widely documented. So is the importance of reducing stress in one’s life. But a new animal study is the first to model stress reduction and ...

Vitamin B reduces work stress

Nov 09, 2011

(Medical Xpress) -- Increasing your Vitamin B intake could significantly reduce work-related stress, a clinical trial conducted at Swinburne University of Technology has shown.

Work stress linked to heart disease

Jan 20, 2006

A British study of 1,000 civil servants found workplace stress is a major factor in the development of heart disease and diabetes.

Recommended for you

Hackathon team's GoogolPlex gives Siri extra powers

13 hours ago

(Phys.org) —Four freshmen at the University of Pennsylvania have taken Apple's personal assistant Siri to behave as a graduate-level executive assistant which, when asked, is capable of adjusting the temperature ...

Microsoft CEO is driving data-culture mindset

Apr 16, 2014

(Phys.org) —Microsoft's future strategy: is all about leveraging data, from different sources, coming together using one cohesive Microsoft architecture. Microsoft CEO Satya Nadella on Tuesday, both in ...

User comments : 0

More news stories

Venture investments jump to $9.5B in 1Q

Funding for U.S. startup companies soared 57 percent in the first quarter to a level not seen since 2001, as venture capitalists piled more money into an increasing number of deals, according to a report due out Friday.

Hackathon team's GoogolPlex gives Siri extra powers

(Phys.org) —Four freshmen at the University of Pennsylvania have taken Apple's personal assistant Siri to behave as a graduate-level executive assistant which, when asked, is capable of adjusting the temperature ...

White House updating online privacy policy

A new Obama administration privacy policy out Friday explains how the government will gather the user data of online visitors to WhiteHouse.gov, mobile apps and social media sites. It also clarifies that ...

Scientists tether lionfish to Cayman reefs

Research done by U.S. scientists in the Cayman Islands suggests that native predators can be trained to gobble up invasive lionfish that colonize regional reefs and voraciously prey on juvenile marine creatures.

Leeches help save woman's ear after pit bull mauling

(HealthDay)—A pit bull attack in July 2013 left a 19-year-old woman with her left ear ripped from her head, leaving an open wound. After preserving the ear, the surgical team started with a reconnection ...