Deep learning merges advantages of holography and bright-field microscopy for 3-D imaging

March 7, 2019, Chinese Academy of Sciences
Bright-field Holography (BH): a novel technique for high contrast microscopic object imaging in sample volumes. Credit: UCLA Engineering Institute for Technology Advancement

Digital holographic microscopy is an imaging modality that can digitally reconstruct the images of 3-D samples from a single hologram by digitally refocusing it through the entire 3-D sample volume. In comparison, scanning through a sample volume with a conventional light microscope requires using a mechanical stage to shift the sample and taking multiple images at various depths, which sets a constraint on the achievable imaging speed and throughput. Moreover, holographic imaging can be performed at a fraction of the size and cost of a conventional bright-field microscope, also covering a much larger field of view. This has enabled a myriad of hand-held devices powered by holography for bio-medical diagnostics and environmental sensing applications. Despite these advantages, the resulting images of a holographic microscope in general suffer from light interference related spatial artifacts, which can limit the achievable contrast in the reconstructed hologram.

Researchers at UCLA have developed a novel -based method to overcome these limitations of holographic 3-D imaging. This new method, termed Bright-field Holography, has the best of both worlds as it combines the image contrast advantage of bright-field microscopy and the snapshot volumetric imaging capability of holography. In Bright-field Holography, a deep neural network is trained using co-registered pairs of digitally refocused holograms and their corresponding bright-field microscope to learn the statistical image transformation between two different microscopy modalities. After its training, the takes in a digitally refocused hologram corresponding to a given depth within the sample volume and transforms it into an image that is equivalent to a bright-field microscope image acquired at the same depth, matching the spatial and color contrast as well as the optical sectioning capability of a bright-field microscope. Although the training of such a neural network takes ~40 hours, after it is trained, the network remains fixed and can rapidly create its output image, within a second for a hologram with millions of pixels.

This research has been published in Light: Science and Applications, an open access journal of Springer Nature. The research was led by Dr. Aydogan Ozcan, the Chancellor's Professor of electrical and at the UCLA Henry Samueli School of Engineering and Applied Science, and an associate director of the California NanoSystems Institute (CNSI), along with Yichen Wu a graduate student and Dr. Yair Rivenson, an Adjunct Professor of electrical and computer engineering at UCLA.

"Bright-field Holography bridges the contrast gap between the classical hologram reconstruction methods and a high-end bright-field , while also eliminating the need to use complex hardware and mechanical scanning to rapidly image sample volumes." said Prof. Ozcan. One of the applications that will immediately benefit from this technology is rapid volumetric imaging of dynamic events within large volumes, opening new avenues for significantly advancing high-throughput imaging of liquid samples through deep learning.

Explore further: Deep learning democratizes nano-scale imaging

More information: Yichen Wu et al, Bright-field holography: cross-modality deep learning enables snapshot 3D imaging with bright-field contrast using a single hologram, Light: Science & Applications (2019). DOI: 10.1038/s41377-019-0139-9

Related Stories

Deep learning democratizes nano-scale imaging

December 18, 2018

Many problems in physical and biological sciences as well as engineering rely on our ability to monitor objects or processes at nano-scale, and fluorescence microscopy has been used for decades as one of our most useful information ...

Artificial intelligence detects the presence of viruses

January 9, 2019

Many biosensing applications rely on characterization of specific analytes such as proteins, viruses and bacteria, among many other targets, which can be accomplished by using micro- or nano-scale particles. In such biosensors, ...

Deep learning reconstructs holograms

October 16, 2017

Deep learning has been experiencing a true renaissance especially over the last decade, and it uses multi-layered artificial neural networks for automated analysis of data. Deep learning is one of the most exciting forms ...

Recommended for you

Coffee-based colloids for direct solar absorption

March 22, 2019

Solar energy is one of the most promising resources to help reduce fossil fuel consumption and mitigate greenhouse gas emissions to power a sustainable future. Devices presently in use to convert solar energy into thermal ...

Physicists reveal why matter dominates universe

March 21, 2019

Physicists in the College of Arts and Sciences at Syracuse University have confirmed that matter and antimatter decay differently for elementary particles containing charmed quarks.

ATLAS experiment observes light scattering off light

March 20, 2019

Light-by-light scattering is a very rare phenomenon in which two photons interact, producing another pair of photons. This process was among the earliest predictions of quantum electrodynamics (QED), the quantum theory of ...

How heavy elements come about in the universe

March 19, 2019

Heavy elements are produced during stellar explosion or on the surfaces of neutron stars through the capture of hydrogen nuclei (protons). This occurs at extremely high temperatures, but at relatively low energies. An international ...

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.