Computer scientists create 'light field camera' banishing fuzzy photos

Nov 02, 2005

We've all done it. Lost that priceless Kodak moment by snapping a photo that was grainy, dark, overexposed or out of focus. While user ineptitude is often at the root of our blurry snapshots, the limits of conventional cameras can be to blame as well. But Stanford computer scientists are now making strides to combat the fuzzy photo by bringing photographic technology into sharp focus.

Ren Ng, a computer science graduate student in the lab of Pat Hanrahan, the Canon USA Professor in the School of Engineering, has developed a "light field camera" capable of producing photographs in which subjects at every depth appear in finely tuned focus. Adapted from a conventional camera, the light field camera overcomes low-light and high-speed conditions that plague photography and foreshadows potential improvements to current scientific microscopy, security surveillance and sports and commercial photography.

"Currently, cameras have to make decisions about the focus before taking the exposure, which engineering-wise can be very difficult," said Ng. "With the light field camera, you can take one exposure, capture a lot more information about the light and make focusing decisions after you've already taken the shot. It is more flexible."


The light field camera, sometimes referred to as a "plenoptic camera," looks and operates exactly like an ordinary handheld digital camera. The difference lies inside. In a conventional camera, rays of light are corralled through the camera's main lens and converge on the film or digital photosensor directly behind it. Each point on the resulting two-dimensional photo is the sum of all the light rays striking that location.

The light field camera adds an additional element—a microlens array—inserted between the main lens and the photosensor. Resembling the multi-faceted compound eye of an insect, the microlens array is a square panel composed of nearly 90,000 miniature lenses. Each lenslet separates back out the converged light rays received from the main lens before they hit the photosensor and changes the way the light information is digitally recorded. Custom processing software manipulates this "expanded light field" and traces where each ray would have landed if the camera had been focused at many different depths. The final output is a synthetic image in which the subjects have been digitally refocused.

Tweaking tradition

Expanding the light field demands that the rules of traditional photography be tweaked. Ordinarily, a tradeoff exists between aperture size, which determines the amount of light reaching the film or photosensor, and depth of field, which determines which objects in an image will be sharp and which will be fuzzy. As the aperture size increases, more light passes through the lens and the depth of field shallows—bringing into focus only the nearest objects and severely blurring the surrounding subjects.

The light field camera decouples aperture size and depth of field. The microlens array harnesses the additional light to reveal the depth of each object in the image and project tiny, sharp subimages onto the photosensor. The blurry halo typically surrounding the centrally focused subject is "un-blurred." In this way, the benefits of large apertures—increased light, shorter exposure time, reduced graininess—can be exploited without sacrificing the depth of field or sharpness of the image.

Extending the depth of field while maintaining a wide aperture may provide significant benefits to several industries, such as security surveillance. Often mounted in crowded or dimly lit areas, such as congested airport security lines and backdoor exits, monitoring cameras notoriously produce grainy, indiscernible images.

"Let's say it's nighttime and the security camera is trying to focus on something," said Ng. "If someone comes and they are moving around, the camera will have trouble tracking them. Or if there are two people, whom does it choose to track? The typical camera will close down its aperture to try capturing a sharp image of both people, but the small aperture will produce video that is dark and grainy."

The idea behind the light field camera is not new. With the roots of its conception dating back nearly a century, several variants of the light field camera have been devised over the years, each with slight variations in its optical system. Other models that rely on refocusing light fields have been slow and bulky and have generated gaps in the light fields, known as aliasing. Ng's camera—compact and portable with drastically reduced aliasing—displays greater commercial utility.

Marc Levoy, professor of computer science and electrical engineering; Mark Horowitz, the Yahoo! Founders Professor in the School of Engineering; Mathieu Bredif, M.S. '05 in computer science; and Gene Duval, B.S. '75, M.S. '78 in mechanical engineering and founder of Duval Design, also contributed to this work.

The research was supported by the Office of Technology Licensing Birdseed Fund, which provides small grants for the prototype development of unlicensed technologies. A manuscript detailing the theoretic performance of the light field camera appeared in Transactions on Graphics, published by the Association for Computing Machinery in July, and subsequently was presented at the 2005 ACM SIGGRAPH (Special Interest Group on Computer Graphics and Interactive Techniques) conference in August in Los Angeles.

Source: Stanford University

Explore further: Cougars' diverse diet helped them survive the Pleistocene mass extinction

add to favorites email to friend print save as pdf

Related Stories

The importance of plumes

Apr 18, 2014

The Hubble Space Telescope is famous for finding black holes. It can pick out thousands of galaxies in a patch of sky the size of a thumbprint. The most powerful space telescope ever built, the Hubble provided ...

Robotics goes micro-scale

Apr 17, 2014

(Phys.org) —The development of light-driven 'micro-robots' that can autonomously investigate and manipulate the nano-scale environment in a microscope comes a step closer, thanks to new research from the ...

Pushy neighbors force stellar twins to diverge

Apr 15, 2014

(Phys.org) —Much like an environment influences people, so too do cosmic communities affect even giant dazzling stars: Peering deep into the Milky Way galaxy's center from a high-flying observatory, Cornell ...

The science of anatomy is undergoing a revival

Apr 10, 2014

Only two decades ago, when I was starting my PhD studies at the University of California in Berkeley, there was talk about the death of anatomy as a research subject. That hasn't happened. Instead the science ...

Recommended for you

Math modeling handbook now available

1 hour ago

Math comes in handy for answering questions about a variety of topics, from calculating the cost-effectiveness of fuel sources and determining the best regions to build high-speed rail to predicting the spread ...

Archaeologists, tribe clash over Native remains

2 hours ago

Archaeologists and Native Americans are clashing over Indian remains and artifacts that were excavated during a construction project in the San Francisco Bay Area, but then reburied at an undisclosed location.

Male-biased tweeting

4 hours ago

Today women take an active part in public life. Without a doubt, they also converse with other women. In fact, they even talk to each other about other things besides men. As banal as it sounds, this is far ...

Developing nations ride a motorcycle boom

5 hours ago

Asia's rapidly developing economies should prepare for a full-throttle increase in motorcycle numbers as average incomes increase, a new study from The Australian National University has found.

User comments : 0

More news stories

Male-biased tweeting

Today women take an active part in public life. Without a doubt, they also converse with other women. In fact, they even talk to each other about other things besides men. As banal as it sounds, this is far ...

Archaeologists, tribe clash over Native remains

Archaeologists and Native Americans are clashing over Indian remains and artifacts that were excavated during a construction project in the San Francisco Bay Area, but then reburied at an undisclosed location.

Math modeling handbook now available

Math comes in handy for answering questions about a variety of topics, from calculating the cost-effectiveness of fuel sources and determining the best regions to build high-speed rail to predicting the spread ...