Researchers bring noise to virtual worlds

October 27, 2009 By Bill Steele
Whether metal or plastic, objects made up of thin shells have a characteristic way of making noise that can be simulated by a computer to synthesize sound for animated films and virtual reality. Image: James Lab/Cornell University

( -- Computer scientists have developed a method to synthesize the sounds of cymbals, falling garbage cans and lids, and plastic water-cooler bottles and recycling bins.

When you kick over a garbage can, it doesn't make a pure, musical tone. That's why the sound is so hard to synthesize.

But now Cornell have developed a practical method to generate the crashing and rumbling sounds of objects made up of thin "harmonic shells," including the sounds of cymbals, falling garbage cans and lids, and plastic water-cooler bottles and recycling bins.

The work by graduate students Jeffrey Chadwick and Steven An and Doug James, associate professor of computer science, will be presented at the SIGGRAPH Asia conference in Yokohama, Japan, in December.

As virtual environments become more realistic and immersive, the researchers point out, computers will have to generate sounds that match the behavior of objects in real time. Even in an animated movie, where sound effects can be dubbed in after the fact from recordings of real sounds, synthesized sounds can match more realistically to the action. So the goal is to start with the computer model of an object already created by animators, analyze how such an object would vibrate when dropped or struck, and how that vibration would be transferred to the air to radiate as sound.

When a thin-shelled object is struck or falls, the metal or plastic sheet slightly deforms and snaps back, triggering a vibration. To simulate the deformation, the computer divides the shell into many small triangles and calculates how the angles between triangles change and how much the sides of the triangles are stretched. What makes this difficult is that the shell vibrates in several different ways at once, and these modes of vibration are "coupled" -- energy transfers from one to another and back again. Previous methods of sound synthesis for shells did not take this into account, James said, and the result was a clean, clear sound, appropriate for bells and wind chimes, but not for things that crash and rumble.

The calculation must be stepped through time at audio frequencies, in this case seeing how the object will look every 1/44,100 of a second. Time-stepping a large mesh of triangles would take weeks of computer time, so the researchers approximate the response by sampling a few hundred triangles (out of thousands) and interpolate between them, a process they call "cubature."

The final step is to map out how the sound waves radiate to determine how the event will sound to a listener at any particular location. Calculating how vibrations of the object move the air is a standard, off-the-shelf process used by engineers who design real-world objects (a lot of work goes into making machinery quieter), but it's too slow for sound synthesis, so the radiation model is pre-computed to save time.

Even with these refinements, the system is not ready for real time, James reported. The computations for simple demonstrations still take about an hour on a laptop computer.

"There's some hope that we can speed this up," he said, "by making other approximations." Nevertheless, he said, previous methods of generating these sounds could take weeks, "but now we can do it in hours."

The work on thin shells is part of a larger project in James' lab to synthesize a variety of sounds, including those of dripping and splashing fluids, small objects clattering together and shattering glass.

Provided by Cornell University (news : web)

Explore further: Making realistic sounds for computer animation (w/Video)

Related Stories

Modeling the Sound of Music

October 3, 2005

If a musical instrument has never been built before, how can you know what it will sound like? That's the question UC Berkeley graduate student Cynthia Bruyns is answering with Vibration Lab, software she's designing to simulate ...

DISSCO makes 'music' for Argonne, UIUC researchers

June 21, 2005

A mathematician and a musician have teamed up to create a new computer program that both composes music and creates the instrumentation to play it. The software is available for free from

Researchers produce 'neural fingerprint' of speech recognition

November 10, 2008

Scientists from Maastricht University (Netherlands) have developed a method to look into the brain of a person and read out who has spoken to him or her and what was said. With the help of neuroimaging and data mining techniques ...

Recommended for you

Volumetric 3-D printing builds on need for speed

December 11, 2017

While additive manufacturing (AM), commonly known as 3-D printing, is enabling engineers and scientists to build parts in configurations and designs never before possible, the impact of the technology has been limited by ...

Tech titans ramp up tools to win over children

December 10, 2017

From smartphone messaging tailored for tikes to computers for classrooms, technology titans are weaving their way into childhoods to form lifelong bonds, raising hackles of advocacy groups.

Mapping out a biorobotic future  

December 8, 2017

You might not think a research area as detailed, technically advanced and futuristic as building robots with living materials would need help getting organized, but that's precisely what Vickie Webster-Wood and a team from ...

1 comment

Adjust slider to filter visible comments by rank

Display comments: newest first

not rated yet Oct 28, 2009
This is a slowly advancing field, but I'm glad they're still trying. It is the way to go. The sound cards will probably have a great comeback one day. It is a good news, that they solved the friction involved vibrations, even thou it's still slow as yet.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.