3D-printed artificial intelligence running at the speed of light—from object classification to optical component design

July 30, 2018 by Maxim Batalin, UCLA Ozcan Research Group
Credit: Ozcan Lab @ UCLA

Deep learning is one of the fastest-growing machine learning methods that relies on multi-layered artificial neural networks. Traditionally, deep learning systems are implemented to be executed on a computer to digitally learn data representation and abstraction, and perform advanced tasks, comparable to or even superior than the performance of human experts. Recent successful applications of deep learning include medical image analysis, speech recognition, language translation, image classification, as well as addressing more specific tasks, such as solving inverse imaging problems.

In contrast to the traditional implementations of , in a recent article published in Science, UCLA researchers have introduced a physical mechanism to implement deep learning using an all-optical Diffractive Deep Neural Network (D2NN). This new framework results in 3D-printed structures, designed by deep learning, that were shown to successfully perform different kinds of classification and imaging tasks without the use of any power, except the input light beam. This all-optical can perform, at the speed of light, various complex functions that computer-based neural networks can implement, and will find applications in all-optical image analysis, feature detection and object classification, also enabling new camera designs and optical components that can learn to perform unique tasks.

This research was led by Dr. Aydogan Ozcan, the Chancellor's Professor of electrical and computer engineering at UCLA and an HHMI Professor with the Howard Hughes Medical Institute.

The authors validated the effectiveness of this approach by creating 3D-printed diffractive networks that were successful in solving sample problems, such as the classification of the images of handwritten digits (from 0 to 9) and fashion products as well as performing the function of an imaging lens at terahertz spectrum.

"Using passive components that are fabricated by layer, and connecting these layers to each other via light diffraction created a unique all-optical platform to perform machine learning tasks at the speed of light," said Dr. Ozcan. By using image data, the authors designed tens of thousands of pixels at each layer that, together with the other layers, collectively perform the the network was trained for. After its training, which is done using a computer, the design is 3D-printed or fabricated to form a stack of layers that use optical diffraction to execute the learned task.

In addition to image classification tasks that the authors have demonstrated using handwritten digits and fashion products, this diffractive neural network architecture was also used to design a multi-layered lens that operates at terahertz spectrum, creating an image of an arbitrary input object at the output of the network, without any understanding of the physical laws associated with image formation. Such a design was created using only image data that were used to train the pixel values across different layers to form an imaging system in the form of a diffractive .

This proof of concept work highlights some unique opportunities that deep learning enables for optical component design based on , rather than physical principles or engineering intuition. Based on this new approach, more advanced optical components can be designed based on data, potentially surpassing the performance of traditional components.

The other authors of this work, all from the UCLA Samueli School of Engineering, include postdoctoral scholars Xing Lin; Yair Rivenson, and  Nezih T. Yardimci; graduate students Muhammed Veli and Yi Luo; and Mona Jarrahi, UCLA professor of electrical and computer engineering.

This work was supported by NSF and HHMI.

Explore further: Deep learning extends imaging depth and speeds up hologram reconstruction

More information: Xing Lin et al. All-optical machine learning using diffractive deep neural networks, Science (2018). DOI: 10.1126/science.aat8084

Related Stories

Deep learning reconstructs holograms

October 16, 2017

Deep learning has been experiencing a true renaissance especially over the last decade, and it uses multi-layered artificial neural networks for automated analysis of data. Deep learning is one of the most exciting forms ...

A neural network that operates at the speed of light

July 27, 2018

A team of researchers at the University of California has developed a novel kind of neural network—one that uses light instead of electricity to arrive at results. In their paper published in the journal Science, the group ...

Recommended for you

Bursting bubbles launch bacteria from water to air

November 15, 2018

Wherever there's water, there's bound to be bubbles floating at the surface. From standing puddles, lakes, and streams, to swimming pools, hot tubs, public fountains, and toilets, bubbles are ubiquitous, indoors and out.

Terahertz laser pulses amplify optical phonons in solids

November 15, 2018

A study led by scientists of the Max Planck Institute for the Structure and Dynamics of Matter (MPSD) at the Center for Free-Electron Laser Science in Hamburg/Germany presents evidence of the amplification of optical phonons ...

Designer emulsions

November 15, 2018

ETH material researchers are developing a method with which they can coat droplets with controlled interfacial composition and coverage on demand in an emulsion in order to stabilise them. In doing so they are fulfilling ...

Quantum science turns social

November 15, 2018

Researchers in a lab at Aarhus University have developed a versatile remote gaming interface that allowed external experts as well as hundreds of citizen scientists all over the world to optimize a quantum gas experiment ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.