UCLA engineers use deep learning to reconstruct holograms and improve optical microscopy

November 20, 2017, UCLA Ozcan Research Group
The technique developed at UCLA uses deep learning to produce high-resolution pictures from lower-resolution microscopic images. Credit: UCLA Ozcan Research Group

A form of machine learning called deep learning is one of the key technologies behind recent advances in applications like real-time speech recognition and automated image and video labeling.

The approach, which uses multi-layered to automate data analysis, also has shown significant promise for health care: It could be used, for example, to automatically identify abnormalities in patients' X-rays, CT scans and other medical images and data.

In two new papers, UCLA researchers report that they have developed new uses for : reconstructing a hologram to form a microscopic image of an object and improving optical microscopy.

Their new holographic imaging technique produces better images than current methods that use multiple holograms, and it's easier to implement because it requires fewer measurements and performs computations faster.

The research was led by Aydogan Ozcan, an associate director of the UCLA California NanoSystems Institute and the Chancellor's Professor of Electrical and Computer Engineering at the UCLA Henry Samueli School of Engineering and Applied Science; and by postdoctoral scholar Yair Rivenson and graduate student Yibo Zhang, both of UCLA's electrical and computer engineering department.

For one study, published in Light: Science and Applications, the researchers produced holograms of Pap smears, which are used to screen for cervical cancer, and blood samples, as well as breast tissue samples. In each case, the neural network learned to extract and separate the features of the true image of the object from undesired light interference and from other physical byproducts of the image reconstruction process.

"These results are broadly applicable to any phase recovery and holographic imaging problem, and this deep-learning–based framework opens up myriad opportunities to design fundamentally new coherent imaging systems, spanning different parts of the electromagnetic spectrum, including visible wavelengths and even X-rays," said Ozcan, who also is an HHMI Professor at the Howard Hughes Medical Institute.

Another advantage of the new approach was that it was achieved without any modeling of light–matter interaction or a solution of the wave equation, which can be challenging and time-consuming to model and calculate for each individual sample and form of light.

"This is an exciting achievement since traditional physics-based hologram reconstruction methods have been replaced by a deep-learning–based computational approach," Rivenson said.

Other members of the team were UCLA researchers Harun Günaydin and Da Teng, both members of Ozcan's lab.

The second study, published in the journal Optica, the researchers used the same deep-learning framework to improve the resolution and quality of optical microscopic images.

That advance could help diagnosticians or pathologists looking for very small-scale abnormalities in a large blood or tissue sample, and Ozcan said it represents the powerful opportunities for deep learning to improve for medical diagnostics and other fields in engineering and the sciences.

Explore further: Deep learning reconstructs holograms

More information: Ozcan's research is supported by the National Science Foundation–funded Precise Advanced Technologies and Health Systems for Underserved Populations and by the NSF, as well as the Army Research Office, the National Institutes of Health, the Howard Hughes Medical Institute, the Vodafone Americas Foundation and the Mary Kay Foundation.

Related Stories

Deep learning reconstructs holograms

October 16, 2017

Deep learning has been experiencing a true renaissance especially over the last decade, and it uses multi-layered artificial neural networks for automated analysis of data. Deep learning is one of the most exciting forms ...

High-resolution microscopy without a lens

September 5, 2012

(Phys.org)—Over the past several years, major advances have been made at UCLA in the field of lens-less computational imaging technology, particularly in the design of lens-free holographic microscopes, which, because of ...

Recommended for you

Diagnosing breast cancer using red light

March 23, 2018

Optical Mammography, or OM, which uses harmless red or infrared light, has been developed for use in conjunction with X-rays for diagnosis or monitoring in cases demanding repeated imaging where high amounts of ionizing radiation ...

Designing a new material for improved ultrasound

March 22, 2018

Development of a theoretical basis for ultrahigh piezoelectricity in ferroelectric materials led to a new material with twice the piezo response of any existing commercial ferroelectric ceramics, according to an international ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.