Modeling the Sound of Music

Oct 03, 2005

If a musical instrument has never been built before, how can you know what it will sound like? That's the question UC Berkeley graduate student Cynthia Bruyns is answering with Vibration Lab, software she's designing to simulate the sound of any percussive instrument, real or imagined, in a computer.

Her system could someday enable musicians to play instruments that exist only on the screen, enable the interactive design of new physical instruments, and even boost the realism of immersive virtual environments for education and training.

"Every object's sound comes from the way it's vibrating, and every object vibrates differently depending on its shape and material," says Bruyns, a student of computer science professor Carlo Séquin, an affiliate of the Center for Information Technology Research in the Interest of Society (CITRIS). "Instruments like violins are shapes that have been perfected over many years to produce a certain tone."

Bruyns' software enables users to take a computer-generated 3D model of a complex object and, essentially, bang it with a virtual stick to hear how it vibrates. For example, thin and flat metal objects sound very different from thick, curved wooden instruments. This is a giant leap in ease-of-use compared to state-of-the-art virtual instrument software.

Previously, Bruyns explains, some computer musicians have created virtual instruments from shapes like circles, squares, and rectangles that are relatively easy to model on a computer. The software then calculates how a vibration wave propagates through the shape, resulting in a tone. More commonly, electronic musicians create instrument sounds by manipulating digital oscillators and tweaking a host of other parameters until they hear the tone they're after. Someday, Bruyns hopes her software could lead to a user-friendly library of 3D instrument models that a composer could modify without much programming knowledge.

Bruyns' software is based on techniques of modal analysis, the mathematical process of breaking a vibration down into its component parts, such as frequency and damping. Beginning with a 3D model built with commercially-available software, the Vibration Lab system adds mass and stiffness properties that mimic the characteristics of a real material like wood or bronze. The frequencies of the object are then calculated. Users can then "strike" the object in various places by hitting keys on an electronic piano keyboard connected to the computer using a standard digital music interface.

To test the system, Bruyns recorded the sound of striking real world objects she fabricated and compared that frequency spectrum with a hit on the object's virtual counterpart. The structures were metal letters that spelled out SIGGRAPH, the name of a scientific conference where she presented her work last year. The difference in frequency between the real and virtual objects ranged from just seven to 10 percent. Room acoustic effects can also be added using additional pieces of software.

Along with applications in electronic music, Bruyns hopes that her software could be used as a tool for real world instrument designers. She was inspired by the work of Séquin's friend Steve Reinmuth, an Oregon artist who sculpts exotic bells out of bronze.

"These sculptors make futuristic shapes that look like alien instruments and have very pretty tones," she says. "But a lot of that is trial and error. It would be nice to give the artists a tool to predict what their shapes will sound like."

Eventually, the system could also add realistic audio to an immersive computer-generated environment in development within CITRIS. The idea of the project, led by former CITRIS director Ruzena Bajcsy, is to enable individuals in remote places to gather via the Internet in a shared virtual environment created with digital cameras, computer graphics, and synthesized sound.

Not surprisingly, Bruyns has already been approached by companies interested in commercializing Vibration Lab. Right now though, she's focused on completing her PhD, probably in the next year or so. The next stage in the research is to simulate how air enclosed in the body of an instrument will affect its sound. To start, she's studying the timpani, a large drum with a sealed enclosure full of air.

"In the future, the software might enable me to take a 3D model of a tabla drum, for example, and know what it would sound like if it was made from solid gold."

Source: UC Berkeley, by by David Pescovitz

Explore further: North Korea behind Sony hack, FBI says

add to favorites email to friend print save as pdf

Related Stories

People finding their 'waze' to once-hidden streets

15 minutes ago

When the people whose houses hug the narrow warren of streets paralleling the busiest urban freeway in America began to see bumper-to-bumper traffic crawling by their homes a year or so ago, they were baffled.

Identity theft victims face months of hassle

25 minutes ago

As soon as Mark Kim found out his personal information was compromised in a data breach at Target last year, the 36-year-old tech worker signed up for the retailer's free credit monitoring offer so he would ...

Observers slam 'lackluster' Lima climate deal

35 minutes ago

A carbon-curbing deal struck in Lima on Sunday was a watered-down compromise where national intransigence threatened the goal of a pact to save Earth's climate system, green groups said.

Your info has been hacked. Now what do you do?

45 minutes ago

Criminals stole personal information from tens of millions of Americans in data breaches this past year. Of those affected, one in three may become victims of identity theft, according to research firm Javelin. ...

New Bond script stolen in Sony hack

49 minutes ago

An "early version" of the screenplay for the new James Bond film was the latest victim of a massive hacking attack on Sony Pictures Entertainment, its producers said in a statement on their website Sunday.

Ag-tech could change how the world eats

6 hours ago

Investors and entrepreneurs behind some of the world's newest industries have started to put their money and tech talents into farming - the world's oldest industry - with an audacious agenda: to make sure there is enough ...

Recommended for you

North Korea behind Sony hack, FBI says

1 minute ago

North Korea was responsible for a "destructive" cyber attack on Sony Pictures, the US Federal Bureau of Investigation said Friday, warning it would hunt down the perpetrators and make them pay.

Clooney slams skittish Hollywood after Sony hack

2 hours ago

Film star George Clooney slammed the Hollywood movie industry for failing to stand up against the cyber threats that prompted Sony Pictures to cancel release of the movie "The Interview."

The state of shale

2 hours ago

University of Pittsburgh researchers have shared their findings from three studies related to shale gas in a recent special issue of the journal Energy Technology, edited by Götz Veser, the Nickolas A. DeCecco Professor of Che ...

Coping with floods—of water and data

3 hours ago

Halloween 2013 brought real terror to an Austin, Texas, neighborhood, when a flash flood killed four residents and damaged roughly 1,200 homes. Following torrential rains, Onion Creek swept over its banks and inundated the ...

User comments : 0

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.