Researchers bring noise to virtual worlds

Oct 27, 2009 By Bill Steele
Whether metal or plastic, objects made up of thin shells have a characteristic way of making noise that can be simulated by a computer to synthesize sound for animated films and virtual reality. Image: James Lab/Cornell University

(PhysOrg.com) -- Computer scientists have developed a method to synthesize the sounds of cymbals, falling garbage cans and lids, and plastic water-cooler bottles and recycling bins.

When you kick over a garbage can, it doesn't make a pure, musical tone. That's why the sound is so hard to synthesize.

But now Cornell have developed a practical method to generate the crashing and rumbling sounds of objects made up of thin "harmonic shells," including the sounds of cymbals, falling garbage cans and lids, and plastic water-cooler bottles and recycling bins.

The work by graduate students Jeffrey Chadwick and Steven An and Doug James, associate professor of computer science, will be presented at the SIGGRAPH Asia conference in Yokohama, Japan, in December.

As virtual environments become more realistic and immersive, the researchers point out, computers will have to generate sounds that match the behavior of objects in real time. Even in an animated movie, where sound effects can be dubbed in after the fact from recordings of real sounds, synthesized sounds can match more realistically to the action. So the goal is to start with the computer model of an object already created by animators, analyze how such an object would vibrate when dropped or struck, and how that vibration would be transferred to the air to radiate as sound.

When a thin-shelled object is struck or falls, the metal or plastic sheet slightly deforms and snaps back, triggering a vibration. To simulate the deformation, the computer divides the shell into many small triangles and calculates how the angles between triangles change and how much the sides of the triangles are stretched. What makes this difficult is that the shell vibrates in several different ways at once, and these modes of vibration are "coupled" -- energy transfers from one to another and back again. Previous methods of sound synthesis for shells did not take this into account, James said, and the result was a clean, clear sound, appropriate for bells and wind chimes, but not for things that crash and rumble.

The calculation must be stepped through time at audio frequencies, in this case seeing how the object will look every 1/44,100 of a second. Time-stepping a large mesh of triangles would take weeks of computer time, so the researchers approximate the response by sampling a few hundred triangles (out of thousands) and interpolate between them, a process they call "cubature."

The final step is to map out how the sound waves radiate to determine how the event will sound to a listener at any particular location. Calculating how vibrations of the object move the air is a standard, off-the-shelf process used by engineers who design real-world objects (a lot of work goes into making machinery quieter), but it's too slow for sound synthesis, so the radiation model is pre-computed to save time.

Even with these refinements, the system is not ready for real time, James reported. The computations for simple demonstrations still take about an hour on a laptop computer.

"There's some hope that we can speed this up," he said, "by making other approximations." Nevertheless, he said, previous methods of generating these sounds could take weeks, "but now we can do it in hours."

The work on thin shells is part of a larger project in James' lab to synthesize a variety of sounds, including those of dripping and splashing fluids, small objects clattering together and shattering glass.

Provided by Cornell University (news : web)

Explore further: Computerized emotion detector

add to favorites email to friend print save as pdf

Related Stories

Modeling the Sound of Music

Oct 03, 2005

If a musical instrument has never been built before, how can you know what it will sound like? That's the question UC Berkeley graduate student Cynthia Bruyns is answering with Vibration Lab, software she's designing to simulate ...

DISSCO makes 'music' for Argonne, UIUC researchers

Jun 21, 2005

A mathematician and a musician have teamed up to create a new computer program that both composes music and creates the instrumentation to play it. The software is available for free from SourceForge.net.

Researchers produce 'neural fingerprint' of speech recognition

Nov 10, 2008

Scientists from Maastricht University (Netherlands) have developed a method to look into the brain of a person and read out who has spoken to him or her and what was said. With the help of neuroimaging and data mining techniques ...

Recommended for you

Computerized emotion detector

Sep 16, 2014

Face recognition software measures various parameters in a mug shot, such as the distance between the person's eyes, the height from lip to top of their nose and various other metrics and then compares it with photos of people ...

Cutting the cloud computing carbon cost

Sep 12, 2014

Cloud computing involves displacing data storage and processing from the user's computer on to remote servers. It can provide users with more storage space and computing power that they can then access from anywhere in the ...

Teaching computers the nuances of human conversation

Sep 12, 2014

Computer scientists have successfully developed programs to recognize spoken language, as in automated phone systems that respond to voice prompts and voice-activated assistants like Apple's Siri.

Mapping the connections between diverse sets of data

Sep 12, 2014

What is a map? Most often, it's a visual tool used to demonstrate the relationship between multiple places in geographic space. They're useful because you can look at one and very quickly pick up on the general ...

User comments : 1

Adjust slider to filter visible comments by rank

Display comments: newest first

SmartK8
not rated yet Oct 28, 2009
This is a slowly advancing field, but I'm glad they're still trying. It is the way to go. The sound cards will probably have a great comeback one day. It is a good news, that they solved the friction involved vibrations, even thou it's still slow as yet.