Matching eyes to math for translucent images

October 1, 2013 by Bill Steele, Cornell University
Matching eyes to math for translucent images
Which of these things is most like the other? By showing human subjects thousands of computer-generated images, researchers measured just how much change in computer input will make a noticeable difference in human perception. The face of the statue is masked out because in pilot studies subjects focused only on the face and missed other fine details.

( —Whether it's a rare jade figurine or an ice sculpture, how light passes through a translucent surface is key to its appearance, and humans are sensitive to subtle differences in the result. So Cornell researchers, with colleagues at Harvard and MIT, are using the techniques of perceptual psychology to find out how to create realistic computer graphics of translucent materials. They have discovered that a previously overlooked bit of math is the key.

Their results were reported at the 2013 SIGGRAPH conference, July 21-25 in Anaheim, Calif., and were published in the August issue of ACM Transactions in Graphics.

Artists could use to guide their work on real-world objects, said Kavita Bala, associate professor of . "You could work with clay, scan it in and see if the real sculpture would look as gorgeous as you hoped," she said.

To create a computer-graphic image, an artist builds a "model" – a set of coordinates that describes the shape of the object. Then the computer calculates how light rays will bounce off that object and arrive at the eye. It's no coincidence that one of the first successful computer-animated movies was about toys; smooth plastic surfaces reflect light in a simple way.

When the surface is translucent, some light is reflected and some passes through, bouncing around for a while and then coming back out. Just how light scatters inside is what makes jade look different from ice or human skin from wax. Instead of studying the physics of light, Bala and her collaborators measured human responses to images.

Matching eyes to math for translucent images
The differences are subtle, but marble, left, scatters light beneath its surface differently than jade, right, in these computer-generated images based on a model of the same statue.

Subjects were shown three images in a row and asked to choose which of those on the ends most resembled the one in the middle. This avoids widely varying subjective descriptions and generates numerical data that can be plotted against the numbers that were fed into the computer to generate the images.

In pilot studies, the researchers learned that one crucial factor in making translucent images different from one another is the "phase function," which determines the possible range of angles at which light going into the surface will be scattered. Previously, they noted, researchers have instead ignored the phase function and used simple models of the angular scattering that miss important visual features in objects with fine details. For their tests, the researchers used images of a delicate statue.

Two different parts of the function control the diffusiveness or "milkiness" and the sharpness or "glassiness" of a computer-generated image. As Bala explains it, if you lay a block of translucent material on a page with text, glassiness is how sharp the text appears, and milkiness is how much light is held back – as if you were looking at the text through milk.

But how much indeed? By asking subjects to compare and performing computer analysis of the results, the researchers were able to establish a scale showing how much a change in the values fed into the phase function would change the appearance of the image.

"If we can determine how similar or dissimilar different materials appear visually, we can build an intuitive interface for designers who edit and visualize materials," Bala explained. The goal is to build software that will allow graphic artists to "turn a knob" and watch how the image changes.

Explore further: Precomputing speeds up cloth imaging

Related Stories

Precomputing speeds up cloth imaging

September 5, 2013

( —Creating a computer graphic model of a uniform material like woven cloth or finished wood can be done by modeling a small volume, like one yarn crossing, and repeating it over and over, perhaps with minor modifications ...

Crowdsourcing creates a database of surfaces

August 28, 2013

( —Computer graphics are moving off the movie screen and into everyday life. Home remodeling specialists, for example, may soon be able to to show you how your kitchen would look with marble countertops or stainless ...

Perfecting digital imaging (w/ Video)

July 23, 2013

Computer graphics and digital video lag behind reality; despite advances, the best software and video cameras still cannot seem to get computer-generated images and digital film to look exactly the way our eyes expect them ...

Software arranges photo lighting after the shoot

August 22, 2013

What often separates professional photographers from amateurs is their mastery of lighting. Lighting can control what parts of an image draw your attention, or whether an object looks expensive or cheesy. And even for pros, ...

Recommended for you

Finnish firm detects new Intel security flaw

January 12, 2018

A new security flaw has been found in Intel hardware which could enable hackers to access corporate laptops remotely, Finnish cybersecurity specialist F-Secure said on Friday.


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.