Team demos breakthrough in analog image processing

Team demos breakthrough in analog image processing
The metamaterial, which is thinner than a human hair, differentiates the object (the Vanderbilt logo), resulting in the edges being selectively imaged. Credit: Vanderbilt University

A research team of Vanderbilt engineers that includes a scientist at Oak Ridge National Laboratory has demonstrated a new ultrathin filter, based on metamaterials, that allows for analog optical image processing. Their work, Flat Optics for Image Differentiation, appears today in the scientific journal, Nature Photonics.

While has become the prevailing technique in a variety of science and engineering disciplines, it requires advanced computers, space to accommodate the computer, and substantial power.

"Most image processing is performed digitally, but optical analog processing has the advantages of being low power and high speed," said Jason Valentine, associate professor of mechanical engineering and deputy director of the Vanderbilt Institute of Nanoscale Science and Engineering. While processing has been performed in the past it generally requires multiple optical lenses resulting in a large system size.

The metamaterial filter, the first of its kind, differentiates the incoming light directly, allowing one to directly image the edges, or boundaries, of the object.

"Edge filtering is a common pre-processing step in object recognition, for instance, detecting the edge of a lane for autonomous vehicles. It can also be used for detecting margins of tumors in medical imagining or in classifying cell size and type in the case of cell sorting for cancer detection," Valentine said.

The metamaterial filter is based on a two-dimensional photonic crystal made from silicon that allows for direct imaging of the edges of an object in all directions. The 'nanophotonic differentiator' can be integrated into an or onto a camera sensor, easily adapting an existing image processing system.

"One of the primary benefits of our approach is the ability to integrate the metamaterial with traditional optical systems. As an example, we built an edge detection microscope by simply placing the metamaterial filter within a commercial optical microscope," said You Zhou, a Ph.D. student in the Interdisciplinary Materials Science Program and one of the four authors. Testing included imaging the cells of onion epidermis, pumpkin stem and pig motor nerve.

The filter—thinner than a —also was integrated with a metamaterial-based lens, resulting in a completely flat, and ultrathin optic that can perform edge imaging. This further reduces the size of traditional optical systems used for this purpose.

"The key feature is the ability to perform image processing at the speed of light while requiring no input power and doing so in an extremely thin form factor," Valentine said. "This opens new doors for real-time and high speed optical analog in applications such as machine vision and biological imaging."

More information: You Zhou et al. Flat optics for image differentiation, Nature Photonics (2020). DOI: 10.1038/s41566-020-0591-3

Journal information: Nature Photonics

Citation: Team demos breakthrough in analog image processing (2020, February 25) retrieved 28 November 2023 from
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

Explore further

Mathematics at the speed of light


Feedback to editors