Making realistic sounds for computer animation (w/Video)

Jun 01, 2009 By Bill Steele
The sounds produced by pouring and splashing water actually result from the vibration of trapped air bubbles. Cornell researchers can simulate those sounds by computing how the bubbles would behave. Image: Doug James

(PhysOrg.com) -- Splash, splatter, babble, sploosh, drip, drop, bloop and ploop!

Those are some of the sounds that have been missing from computer graphic simulations of and other fluids, according to researchers in Cornell's Department of Computer Science, who have come up with new algorithms to simulate such sounds to go with the images.

The work by Doug James, associate professor of , and graduate student Changxi Zheng will be reported at the 2009 ACM SIGGRAPH conference Aug. 3-7 in New Orleans. It is the first step in a broader research program on sound synthesis supported by a $1.2 million grant from the Human Centered Computing Program of the National Science Foundation (NSF) to James, assistant professor Kavita Bala and associate professor Steve Marschner.

This video is not supported by your browser at this time.
Film for SIGGRAPH 2009 Computer Animation Festival. Fluid sounds, such as splashing and pouring, are ubiquitous and familiar but we lack physically based algorithms to synthesize them in computer animation or interactive virtual environments.

In computer-animated movies, sound can be added after the fact from recordings or by Foley artists. But as virtual worlds grow increasingly interactive and immersive, the researchers point out, sounds will need to be generated automatically to fit events that can't be predicted in advance. Recordings can be cued in, but can be repetitive and not always well matched to what's happening.

"We have no way to efficiently compute the sounds of water splashing, paper crumpling, hands clapping, wind in trees or a wine glass dropped onto the floor," the researchers said in their research proposal.

Along with fluid sounds, the research also will simulate sounds made by objects in contact, like a bin of Legos; the noisy vibrations of thin shells, like trash cans or cymbals; and the sounds of brittle fracture, like breaking glass and the clattering of the resulting debris.

All the simulations will be based on the physics of the objects being simulated in computer graphics, calculating how those objects would vibrate if they actually existed, and how those vibrations would produce acoustic waves in the air. Physics-based simulations also can be used in design, just as visual simulation is now, James said. "You can tell what it's going to sound like before you build it," he explained, noting that a lot of effort often goes into making things quieter.

In their SIGGRAPH paper, Zheng and James report that most of the sounds of water are created by tiny air bubbles that form as water pours and splashes. Moving water traps air bubbles on the scale of a millimeter or so. Surface tension contracts the bubbles, compressing the air inside until it pushes back and expands the bubble. The repeated expansion and contraction over milliseconds generates vibrations in the water that eventually make its surface vibrate, acting like a loudspeaker to create sound waves in the air.

The simulation method developed by the Cornell researchers starts with the geometry of the scene, figures out where the bubbles would be and how they're moving, computes the expected vibrations and finally the sounds they would produce. The simulation is done on a highly parallel computer, with each processor computing the effects of multiple bubbles. The researchers have fine-tuned the results by comparing their simulations with real water sounds.

The current methods still require hours of offline computing time, and work best on compact sound sources, the researchers noted, but they said further development should make possible the real-time performance needed for interactive virtual environments and deal with larger sources such as swimming pools or perhaps even Niagara Falls. They also plan to approach the more complex collections of bubbles in foam or plumes.

The research reported in the SIGGRAPH paper was supported in part by an NSF Faculty Early Career Award to James, and by the Alfred P. Sloan Foundation, Pixar, Intel and Autodesk.

Provided by Cornell University (news : web)

Explore further: Enabling a new future for cloud computing

add to favorites email to friend print save as pdf

Related Stories

Researchers produce 'neural fingerprint' of speech recognition

Nov 10, 2008

Scientists from Maastricht University (Netherlands) have developed a method to look into the brain of a person and read out who has spoken to him or her and what was said. With the help of neuroimaging and data mining techniques ...

Swedish research can make Super Mario more realistic

Mar 06, 2009

Computer games are being developed at an ever more rapid pace, and the technical demands are rising, not least regarding graphics boards.  At Mälardalen University in Sweden, researchers have now found a solution to ...

Modeling the Sound of Music

Oct 03, 2005

If a musical instrument has never been built before, how can you know what it will sound like? That's the question UC Berkeley graduate student Cynthia Bruyns is answering with Vibration Lab, software she's designing to simulate ...

Sounding out heart problems automatically

Jul 11, 2008

Sounding the chest with a cold stethoscope is probably one of the most commonly used diagnostics in the medical room after peering down the back of the throat while the patient says, "Aaaah". But, research published in the ...

Recommended for you

Enabling a new future for cloud computing

13 hours ago

The National Science Foundation (NSF) today announced two $10 million projects to create cloud computing testbeds—to be called "Chameleon" and "CloudLab"—that will enable the academic research community ...

Hacking Gmail with 92 percent success

Aug 21, 2014

(Phys.org) —A team of researchers, including an assistant professor at the University of California, Riverside Bourns College of Engineering, have identified a weakness believed to exist in Android, Windows ...

User comments : 1

Adjust slider to filter visible comments by rank

Display comments: newest first

jldb
5 / 5 (2) Jun 01, 2009
This is cute. It would be neat to use the model in reverse. i.e. fit the model to recorded sound from real fluid flows to infer properties of the fluid (viscosity etc). I seem to remember some work along these lines applied to diagnosing various issues related to vascular flows.

If you think about it, the common Systolic and Diastolic measurements associated with blood pressure are a first order solution of this inverse problem. In principle there is a great deal more information about the vascular system hidden in the details of the pressure waves (sound) generated by blood flow.