Research team introduces wearable audio dataset

Illinois research team introduces wearable audio dataset
Recordings with many different hats, headphones and clothing styles are included within the data collected by the researchers. Credit: Coordinated Science Laboratory at the University of Illinois at Urbana-Champaign

Researchers studying wearable listening technology now have a new data set to use, thanks to University of Illinois at Urbana-Champaign graduate student Ryan Corey and his team.

Debuting at the International Conference on Acoustics, Speech, and Signal Processing (ICASSP) this week, the first-of-its-kind wearable microphone impulse response data set is invaluable to audio research for two reasons: First, the data includes up to 80 microphones instead of the usual two showing how is heard on different parts of the body, and second, the data is available for free under an open-access license.

"We believe hearing aids, smart headphones and all listening devices would work better if they had a lot of microphones, but most products only have two," said Corey. "There isn't data out there for more than that. Even the work that has been done with more didn't include open-access data sets."

The data set consists of more than 8,000 acoustic impulse responses measured at 80 different position on the body. The 80 microphones were tested on five different hat/headphone styles and with six different types of clothing. The sound in the recordings came from 24 different directions to simulate noisy crowds.

Illinois research team introduces wearable audio dataset
Microphones were placed on 80 different places on a mannequin and sound was played from 24 different directions to create the data set. Credit: Coordinated Science Laboratory at the University of Illinois at Urbana-Champaign

The group, including Corey's adviser, Professor Andrew Singer from the Coordinated Science Laboratory (CSL), and former undergraduate student Naoki Tsuda, spent weeks placing 80 microphones all over a mannequin and Corey himself in the CSL Augmented Listening Laboratory. They then recorded acoustic impulse responses to study the acoustics of the body and whether or not clothes plays a difference in how microphones pick up noise. The collected data is used by the team in the paper being presented at ICASSP this week, but they wanted the data to go farther.

"We've been frustrated when trying to use that aren't open," said Corey. "Wearable arrays are important and more people should research it. Having this data out there will make it more convenient to do so."

Future researchers can use the data to simulate wearable arrays with different numbers of microphones at different points on the body. Many humans are already wearing multiple devices with microphones, and this data could help take advantage of that. Engineers can use it to design new products and study performance tradeoffs for different applications. A few of the potential applications for the data include augmented reality, speech recognition, and acoustic event detection, among others. Without the data set created by the CSL team, each researcher would have to build their own prototypes and test them, which is time-consuming and expensive.

Illinois research team introduces wearable audio dataset
Team lead Ryan Corey and a mannequin, both of which were covered with 80 microphones during the research. Credit: Coordinated Science Laboratory at the University of Illinois at Urbana-Champaign

The presentation takes place on Tuesday, May 14, in Brighton, UK. Singer, Fox Family Professor in Electrical and Computer Engineering, and Corey hope the presentation will raise awareness of the dataset, encourage others to use it, and give them to opportunity to receive feedback.

"This is the best-attended conference for audio , so I'll be able to introduce the data set to a lot of researchers who could potentially take advantage of it, build on it, and give us feedback for future improvement," said Corey.

The data set is available under a Creative Commons Attribution License at the University of Illinois Library's Illinois Data Bank archives. Corey also has written about the dataset on the lab's blog.


Explore further

Researchers design sounds that can be recorded by microphones but inaudible to humans

More information: DOI: 10.13012/B2IDB-1932389_V1
Citation: Research team introduces wearable audio dataset (2019, May 14) retrieved 21 May 2019 from https://phys.org/news/2019-05-team-wearable-audio-dataset.html
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.
7 shares

Feedback to editors

User comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more