This article has been reviewed according to Science X's editorial process and policies. Editors have highlighted the following attributes while ensuring the content's credibility:


trusted source


Physics informed supervised learning framework could make computational imaging faster

Physics informed supervised learning framework could make computational imaging faster
A newly developed physics-informed variational autoencoder (P-VAE) framework. Credit: Vidhya Ganapati

Computational imaging techniques are growing more popular, but the large number of measurements they require often lead to slow speeds or damage to biological samples. A newly developed physics-informed variational autoencoder (P-VAE) framework could help speed up computational imaging by using supervised learning to jointly reconstruct many light sources, each with sparse measurements.

Vidya Ganapati, Assistant Professor of Engineering, Swarthmore College, will present this research at the Optica Imaging Congress. The hybrid meeting will take place 14–17 August 2023 in Boston, Massachusetts.

"This research could be powerful in applications of scientific discovery, taking a computational approach to push imaging devices to see more detail, faster," added Vidhya Ganapati.

Although data-driven approaches can reduce the number of measurements required for computational imaging, they usually require some type of reference data or information that isn't always possible to acquire. The new physics-informed developed by Ganapati and colleagues doesn't require any ground-truth or reference sources.

P-VAE relies on sparse measurements, which are computationally easier to handle because they contain data in which most of the values are zero. For P-VAE, sparse measurements are acquired for each source and then used jointly to reconstruct all the sources. By pooling information from measurements across the dataset and incorporating known information about the forward physics of imaging, prior and posterior distributions can be inferred.

The researchers applied P-VAE to (LED) array microscopy, which replaces the illumination source of a standard wide-field microscope with a programmable two-dimensional LED array. For each object or field of view imaged, LED illumination patterns are used to create an image stack. Each illumination pattern typically corresponds to one image in the stack, but the researchers showed that applying P-VAE decreases the number of images needed per object, thus reducing the overall acquisition time.

They also applied the technique to computed tomography, which images the internal structure of a sample or object by measuring the attenuation of X-rays through an object at different rotations relative to the beam. Although imaging more rotation angles will improve reconstruction, it also increases the X-ray dose and may cause damage. By applying P-VAE, the researchers jointly reconstructed objects using only sparse measurements.

More information: The open-source code and experimental data for LED microscopy is available at: and

The computed tomography code is available at:

Provided by Optica

Citation: Physics informed supervised learning framework could make computational imaging faster (2023, July 25) retrieved 16 April 2024 from
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

Explore further

Sparse holography: A novel method for creating 3D images


Feedback to editors