Learning with light: New system allows optical 'deep learning'

June 12, 2017, Massachusetts Institute of Technology
Credit: Massachusetts Institute of Technology

"Deep Learning" computer systems, based on artificial neural networks that mimic the way the brain learns from an accumulation of examples, have become a hot topic in computer science. In addition to enabling technologies such as face- and voice-recognition software, these systems could scour vast amounts of medical data to find patterns that could be useful diagnostically, or scan chemical formulas for possible new pharmaceuticals.

But the computations these systems must carry out are highly complex and demanding, even for the most powerful computers.

Now, a team of researchers at MIT and elsewhere has developed a new approach to such computations, using light instead of electricity, which they say could vastly improve the speed and efficiency of certain computations. Their results appear today in the journal Nature Photonics in a paper by MIT postdoc Yichen Shen, graduate student Nicholas Harris, professors Marin Soljacic and Dirk Englund, and eight others.

Soljacic says that many researchers over the years have made claims about optics-based computers, but that "people dramatically over-promised, and it backfired." While many proposed uses of such photonic computers turned out not to be practical, a light-based neural-network system developed by this team "may be applicable for deep-learning for some applications," he says.

Traditional computer architectures are not very efficient when it comes to the kinds of calculations needed for certain important neural-network tasks. Such tasks typically involve repeated multiplications of matrices, which can be very computationally intensive in conventional CPU or GPU chips.

After years of research, the MIT team has come up with a way of performing these operations optically instead. "This chip, once you tune it, can carry out matrix multiplication with, in principle, zero energy, almost instantly," Soljacic says. "We've demonstrated the crucial building blocks but not yet the full system."

By way of analogy, Soljacic points out that even an ordinary eyeglass lens carries out a complex calculation (the so-called Fourier transform) on the light waves that pass through it. The way light beams carry out computations in the new photonic chips is far more general but has a similar underlying principle. The new approach uses multiple light beams directed in such a way that their waves interact with each other, producing interference patterns that convey the result of the intended operation. The resulting device is something the researchers call a programmable nanophotonic processor.

The result, Shen says, is that the optical chips using this architecture could, in principle, carry out calculations performed in typical artificial intelligence algorithms much faster and using less than one-thousandth as much energy per operation as conventional electronic chips. "The natural advantage of using light to do matrix multiplication plays a big part in the speed up and power savings, because dense matrix multiplications are the most power hungry and time consuming part in AI algorithms" he says.

The new programmable nanophotonic processor, which was developed in the Englund lab by Harris and collaborators, uses an array of waveguides that are interconnected in a way that can be modified as needed, programming that set of beams for a specific computation. "You can program in any matrix operation," Harris says. The processor guides light through a series of coupled photonic waveguides. The team's full proposal calls for interleaved layers of devices that apply an operation called a nonlinear activation function, in analogy with the operation of neurons in the brain.

To demonstrate the concept, the team set the programmable nanophotonic processor to implement a neural network that recognizes four basic vowel sounds. Even with this rudimentary system, they were able to achieve a 77 percent accuracy level, compared to about 90 percent for conventional systems. There are "no substantial obstacles" to scaling up the system for greater accuracy, Soljacic says.

Englund adds that the programmable nanophotonic processor could have other applications as well, including signal processing for data transmission. "High-speed analog signal processing is something this could manage" faster than other approaches that first convert the signal to digital form, since light is an inherently analog medium. "This approach could do processing directly in the analog domain," he says.

The team says it will still take a lot more effort and time to make this system useful; however, once the system is scaled up and fully functioning, it can find many user cases, such as data centers or security systems. The system could also be a boon for self-driving cars or drones, says Harris, or "whenever you need to do a lot of computation but you don't have a lot of power or time."

Explore further: Next-gen computing: Memristor chips that see patterns over pixels

More information: Yichen Shen et al, Deep learning with coherent nanophotonic circuits, Nature Photonics (2017). DOI: 10.1038/nphoton.2017.93

Related Stories

Scientists slash computations for deep learning

June 1, 2017

Rice University computer scientists have adapted a widely used technique for rapid data lookup to slash the amount of computation—and thus energy and time—required for deep learning, a computationally intense form of ...

Researchers use holography to improve nanophotonic circuits

February 24, 2017

Nanophotonic circuits, tiny chips which filter and steer light, suffer from small random variations which degrade the transmission of light. Researchers have now found a way to compensate those variations, which may lead ...

Recommended for you

The hunt for leptoquarks is on

September 19, 2018

Matter is made of elementary particles, and the Standard Model of particle physics states that these particles occur in two families: leptons (such as electrons and neutrinos) and quarks (which make up protons and neutrons). ...

Searching for errors in the quantum world

September 19, 2018

The theory of quantum mechanics is well supported by experiments. Now, however, a thought experiment by ETH physicists yields unexpected contradictions. These findings raise some fundamental questions—and they're polarising ...

Fiber optic sensor measures tiny magnetic fields

September 19, 2018

Researchers have developed a light-based technique for measuring very weak magnetic fields, such as those produced when neurons fire in the brain. The inexpensive and compact sensors could offer an alternative to the magnetic ...

Researchers push the boundaries of optical microscopy

September 19, 2018

The field of optical microscopy research has developed rapidly in recent years. Thanks to the invention of a technique called super-resolution fluorescence microscopy, it has recently become possible to view even the smaller ...

Extremely small and fast: Laser ignites hot plasma

September 19, 2018

When light pulses from an extremely powerful laser system are fired onto material samples, the electric field of the light rips the electrons off the atomic nuclei. For fractions of a second, a plasma is created. The electrons ...

2 comments

Adjust slider to filter visible comments by rank

Display comments: newest first

Pooua
5 / 5 (2) Jun 13, 2017
"The new approach uses multiple light beams directed in such a way that their waves interact with each other, producing interference patterns that convey the result of the intended operation."

That was my high school Science Fair project in 1984. I worked on it from 1982, and my Gifted and Talented instructor even managed to get me a mentor at the state university's Physics Department.
dirk_bruere
5 / 5 (2) Jun 13, 2017
So dedicated hardware that actually implements neural architecture directly is better than CPU/GPU - who would have guessed it?

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.