Better glasses-free 3-D: A fundamentally new approach

May 04, 2011 by Larry Hardesty
Graphic: Christine Daniloff

Nintendo's 3DS portable gaming system, the first commercial device with a glasses-free 3-D screen, has been available in the United States for barely a month, and it’s already sold more than a million units. Its three-hour battery life, however, is less than half that of its predecessor, the 2-D DS device.

Researchers at MIT’s Media Lab have developed a fundamentally new approach to glasses-free 3-D, called HR3D, which they say could double the battery life of devices like the 3DS without compromising screen brightness or resolution. Among other advantages, the technique could also expand the viewing angle of a 3-D screen, making it practical for larger devices with multiple users, and it would maintain the 3-D effect even when the screen is rotated — something that happens routinely with handheld devices.

According to Doug Lanman, a postdoc in Associate Professor Ramesh Raskar’s Camera Culture Group at the Media Lab, the 3DS relies on a century-old technology known as a parallax barrier. Like most 3-D technologies, this one requires two versions of the same image, one tailored to the left eye and one to the right. The two images are sliced into vertical segments and interleaved on a single surface.

By itself, the composite image looks like an incoherent jumble. But if you place a screen with vertical slits in it — the parallax barrier — just in front of the image and stand the right distance away, a 3-D image pops out. The opaque sections of the screen shield the parts of the image intended for the right eye from the left eye, and vice versa, but the slits allow each eye to see the segments intended for it.

The 3DS screen consists of two parallel liquid-crystal displays (LCDs) a small distance apart. When the device is operating in 3-D mode, the front display serves as the parallax barrier, depicting a series of opaque vertical stripes. Since the stripes block half the light coming from the screen, the device’s backlight has to be twice as bright, which drains the battery twice as quickly. Moreover, because the spacing of the stripes is calibrated to the horizontal separation of human eyes, if the screen is tilted, the 3-D illusion disappears.

All the angles

Raskar and Lanman, along with postdoc Yun Hee Kim and graduate student Matthew Hirsch, decided to rethink glasses-free 3-D from the ground up. In the real world, as a viewer moves around an object, his or her perspective on it changes constantly. A convincing simulation of 3-D visual experience, Lanman argues, might require a display that offers a dozen different perspectives as the viewer moves from right to left.

But with parallax-barrier 3-D, each new perspective further restricts light emission. Adding multiple perspectives in the vertical direction as well as the horizontal would require a parallax barrier with horizontal as well as vertical bands. For a display with enough different views, the parallax barrier ends up looking like an opaque sheet with pinholes poked in it.

Like the 3DS, the MIT researchers’ HR3D system uses two layers of liquid-crystal displays. But instead of displaying vertical bands, as the 3DS does, or pinholes, as a multiperspective parallax-barrier system would, the top LCD displays a pattern customized to the image beneath it.

Going into the project, the researchers had no idea what the customized pattern would look like. But once they’d done the math, they found that the ideal pattern ends up looking a lot like the source image. Instead of consisting of a few big, vertical slits, the parallax barrier consists of thousands of tiny slits, whose orientations follow the contours of the objects in the image.

Number crunching

Because the slits are oriented in so many different directions, the 3-D illusion is consistent no matter whether the image is upright or rotated 90 degrees. Adding more perspectives changes the pattern of the slits, but they allow just as much light to pass.

If a device like the 3DS used HR3D, Lanman says, its battery life would be longer, because the parallax barrier would block less light. The 3-D effect would also be consistent no matter the device’s orientation: applications could actually take advantage of screen rotation, particularly in devices that have built-in motion sensors. “But the real win,” Lanman says, “comes with full parallax motion” — that is, a display that shows multiple perspectives in both the horizontal and vertical directions.

“The great thing about Ramesh’s group is that they think of things that no one else has thought of and then demonstrate that they can actually be done,” says Neil Dodgson, professor of graphics and imaging at the University of Cambridge in England, who was one of the reviewers of the paper when it was accepted last year to the SIGGRAPH Asia graphics conference. “It’s quite a clever idea they’ve got here.”

Dodgson points out, however, that HR3D is very computationally intensive. “If you’re saving battery power because you’ve got this extra brightness, but you’re actually using all that battery power to do the computation, then you’re not saving anything,” he says.

While Lanman acknowledges that the algorithm for calculating the barrier pattern that he and his colleagues described in the SIGGRAPH Asia paper is computationally complex, he believes that it can be refined so that “it requires far less computation.” He also points out that special-purpose chips designed specifically to run a refined version of the algorithm would consume much less power than a general-purpose processor performing the same computations.


This story is republished courtesy of MIT News (web.mit.edu/newsoffice/), a popular site that covers news about MIT research, innovation and teaching.

Explore further: Intelligent materials that work in space

More information: HR3D website - web.media.mit.edu/~mhirsch/hr3d/

Related Stories

3D TV -- Without the Glasses (w/ Video)

Oct 29, 2009

(PhysOrg.com) -- Even with "active shutter" 3D technology for television sets, the wearing of special glasses is still required in order to get the proper experience. They aren't those red and blue or red and ...

Apple patents an inexpensive 3-D projection system

Dec 03, 2010

(PhysOrg.com) -- The U.S. patent office has granted Apple a patent for a 3-D projection system that doesn't require the use of bulky 3-D glasses. This gives the viewer more freedom of movement and viewing ...

Computing with a wave of the hand (w/ Video)

Dec 11, 2009

(PhysOrg.com) -- The iPhone’s familiar touch screen display uses capacitive sensing, where the proximity of a finger disrupts the electrical connection between sensors in the screen. A competing approach, ...

Recommended for you

Intelligent materials that work in space

Oct 23, 2014

ARQUIMEA, a company that began in the Business Incubator in the Science Park of the Universidad Carlos III de Madrid, will be testing technology it has developed in the International Space Station. The technology ...

Using sound to picture the world in a new way

Oct 22, 2014

Have you ever thought about using acoustics to collect data? The EAR-IT project has explored this possibility with various pioneering applications that impact on our daily lives. Monitoring traffic density ...

User comments : 7

Adjust slider to filter visible comments by rank

Display comments: newest first

TechnoCore
5 / 5 (4) May 04, 2011
Smart invention!
SmartK8
not rated yet May 04, 2011
Old professor: To the projection room!
http://www.youtub...gTyXQ4CE
Na_Reth
1 / 5 (2) May 04, 2011
I don't get the 3D hype. I like flatness when escaping from reality... Or reading in 3D is really annoying.
CSharpner
1 / 5 (6) May 04, 2011
Crap! I need to get a patent for my 3D idea I came up with in 1988 before someone else stumbles upon the same idea. They're starting to get close to mine.
CSharpner
1 / 5 (6) May 04, 2011
Crap! I need to get a patent for my 3D idea I came up with in 1988 before someone else stumbles upon the same idea. They're starting to get close to mine.

I got a 1. Somebody doesn't like people having their own ideas, I guess. Funny.
BillFox
2.4 / 5 (5) May 04, 2011
Nobody wants to hear you brag about something you obviously won't describe. Don't you have family willing to tell you that anything is possible and how smart you are? I'd start there and work your way up ;)
Na_Reth
5 / 5 (1) May 06, 2011
And i got 1 rated for stating an opinion... wow :P