Lensless light-field imaging through diffuser encoding

Lensless light-field imaging through diffuser encoding
A diffuser is placed at a small distance in front of a sensor so that a temporally incoherent point source in the detectable field-of-view generates a high-contrast pseudorandom pattern. The elementary sub-beams, represented by their center light rays, are angularly encoded in the pattern Credit: Zewei Cai, Jiawei Chen, Giancarlo Pedrini, Wolfgang Osten, Xiaoli Liu, and Xiang Peng

Microlens array based light-field imaging generally suffers from an intrinsic trade-off between the spatial and angular resolutions. To this end, scientists in China and German jointly proposed a lensless light-field imaging modality by using a diffuser as an encoder. Light rays can be decoupled from a detected image with adjustable spatio-angular resolutions, breaking through the resolution limitation of the sensor. This work indicates the possibility of using scattering media for lensless light-field recording and processing.

Light-field imaging can detect both spatial and angular information of light rays. The angular information offers peculiar capabilities over conventional imaging, such as viewpoint shifting, post-capture refocusing, depth sensing, depth-of-field extension, etc. The concept of plenoptic cameras by adding a pinhole array or microlens array was proposed more than a century ago. Nowadays, microlens array based plenoptic cameras are commonly used for light-field imaging, such as the commercially available products, Lytro and Raytrix. However, these devices confront a trade-off between the spatial and angular resolutions; the is in general tens to hundreds times smaller than the number of pixels used.

In a new paper published in Light Science & Applications, a team of scientists from College of Physics and Optoelectronic Engineering, Shenzhen University, China and Institut für Technische Optik, Universität Stuttgart, German have developed a novel modality for computational light-field imaging by using a diffuser as an encoder, without needing any lens. Through the diffuser, each sub-beam directionally emitted by a point source in the detectable field-of-view forms a distinguishable sub-image that covers a specific region on the sensor. These sub-images are combined into a unique pseudorandom pattern corresponding to the response of the system to the point source.

Consequently, the system has the capability of encoding a light field incident onto the diffuser. We establish a diffuser-encoding light-field transmission model to characterize the mapping of four-dimensional light fields to two-dimensional , where a pixel collects and integrates contributions from different sub-beams. With the aid of the optical properties of the diffuser encoding, the light-field transmission matrix can be flexibly calibrated through a point source generated pattern. As a result, light fields are computationally reconstructed with adjustable spatio-angular resolutions, avoiding the limitation of the sensor.

Lensless light-field imaging through diffuser encoding
a, A raw image was captured by the system. b, Light fields in different spatio-angular samplings were reconstructed from the captured image. Respective focal stacks were then obtained from these reconstructed light fields by performing digital refocusing. c, By using the focal stack, the depth of the measured object was estimated Credit: Zewei Cai, Jiawei Chen, Giancarlo Pedrini, Wolfgang Osten, Xiaoli Liu, and Xiang Peng

The researchers constructed an experimental system using a diffuser and a sensor. The system was demonstrated for distributed object points and area objects, which shows the object-dependent performance of the computational approach. The performance regarding the spatio-angular samplings and measured objects was further analyzed. After that, these scientists made a summary of their approach:

"The improvement of the proposed methodology over the previous work on diffuser-encoding light-field imaging mainly lies in two aspects. One is that our imaging modality is lensless and thus is compact and free of aberration; the other is that the system calibration and decoupling reconstruction become simple and flexible since only one pattern generated by a point source is required," they note

"Based on this single-shot lensless light-field imaging modality, , viewpoints, and focal depths can be manipulated and the occlusion problem can be tackled to some extent. This allows to further investigate the intrinsic mechanism of the light-field propagation through the diffuser. It is also possible to transform the diffuser-encoding light-field representation into the Wigner phase space so that the diffraction effect introduced by the internal tiny structure of the diffuser can be taken into account and lensless light-field microscopy through diffuser encoding may be developed," the scientists conclude.

Explore further

Lensless on-chip microscopy platform shows slides in full view

More information: Zewei Cai et al, Lensless light-field imaging through diffuser encoding, Light: Science & Applications (2020). DOI: 10.1038/s41377-020-00380-x
Journal information: Light: Science & Applications

Citation: Lensless light-field imaging through diffuser encoding (2020, August 24) retrieved 13 April 2021 from https://phys.org/news/2020-08-lensless-light-field-imaging-diffuser-encoding.html
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

Feedback to editors

User comments