New photon-counting camera captures 3-D images with record speed and resolution

New photon-counting camera captures 3D images with record speed and resolution
Researchers have developed the first megapixel photon-counting camera based on single-photon avalanche diode (SPAD) image sensors. The new camera can capture images in faint light at unprecedented speeds. Credit: Arianna M. Charbon, Kazuhiro Morimoto, Edoardo Charbon.

Researchers have developed the first megapixel photon-counting camera based on new-generation image sensor technology that uses single-photon avalanche diodes (SPADs). The new camera can detect single photons of light at unprecedented speeds, a capability that could advance applications that require fast acquisition of 3-D images such as augmented reality and LiDAR systems for autonomous vehicles.

"Thanks to its high resolution and ability to measure depth, this new camera could make virtual reality more realistic and let you interact with augmented reality information in a more seamless manner," said Edoardo Charbon from the Advanced Quantum Architecture Laboratory (AQUALab) at École polytechnique fédérale de Lausanne (EPFL) in Switzerland. Charbon developed the idea for the new camera and is the founder and head of AQUALab, where the was designed.

In Optica, The Optical Society's (OSA) journal for high-impact research, the researchers describe how they created one of the smallest SPAD pixels ever devised and reduced the power consumption of each pixel to less than 1 microwatt while maintaining speed and timing precision. The new camera can acquire images at up to 24,000 frames per second. For comparison, 30 frames per second is the standard rate used to record video for television.

"For transportation applications, this new camera could help achieve unprecedented levels of autonomy and safety by enabling multiple low-power LiDAR devices to be used on a vehicle, providing fast, high-resolution 3-D view of the surroundings," said first author, Kazuhiro Morimoto from Canon Inc. in Japan. "In a somewhat more distant future, quantum communication, sensing and computing could all benefit from photon-counting cameras with multi-megapixel resolution."

A new kind of sensor

In less than 20 years, SPAD sensors have advanced from a novelty to versions that are standard in most smartphone cameras and many household devices. This technology's success comes from the fact that SPAD sensors are extremely efficient at detecting single photons and converting them into that are stored in a digital memory. A large format camera can be created by building an array of pixels that each contain a SPAD.

In the new work, the researchers drew on 15 years of SPAD research at the AQUALab in EPFL to create an extremely fast, high-resolution camera that leverages SPAD technology for advanced imaging. The new camera detects single photons and converts them into electrical signals at a record rate of about 150 million times per second. Each SPAD sensor can be finely controlled to allow light in for as little as 3.8 nanoseconds, roughly four billionth of a second. This quick '' can capture extremely fast motion or be used to increase the dynamic range—the difference between the darkest and lightest tones—of an acquired image.

The researchers created extremely small SPAD pixels and designed for low power consumption by using a feedback mechanism that almost immediately quenches the avalanche of electrons triggered by photon detection. This improves the overall performance and reliability of the pixels. They also used enhanced layout techniques to pack the SPAD tighter, thus upping the detection area density and enabling a camera with a million pixels.

The researchers then applied sophisticated integrated circuit design techniques to create an extremely uniform distribution of fast electrical signals over the large-scale array. They showed that the shutter speeds varied by only 3 percent over the million pixels, demonstrating that this sensor could feasibly be made using available mass-production techniques.

High-speed 3-D imaging

The camera's speed makes it possible to measure the time a photon hits the sensor very precisely. This information can be used to calculate how long it takes individual photons to travel the distance from a source to the camera, known as time-of-flight. Combining time-of-flight information with the ability to capture a million pixels simultaneously enables extremely high-speed reconstruction of 3-D images.

The researchers used the to determine the time-of-flight of photons emitted from a laser source and reflected by a target. They also captured complex scenes that are difficult for other imaging techniques to measure, such as an object viewed through a partially transparent window, and they used the camera to acquire conventional pictures with unprecedented dynamic ranges. In future they plan to further improve the performance and timing resolution of the and to further miniaturize the components to make it more practical for a variety of applications.


Explore further

Researchers generate 3D images using just one photon per pixel (w/ video)

More information: Kazuhiro Morimoto et al, A megapixel time-gated SPAD image sensor for 2D and 3D imaging applications, Optica (2020). DOI: 10.1364/OPTICA.386574
Journal information: Optica

Citation: New photon-counting camera captures 3-D images with record speed and resolution (2020, April 16) retrieved 27 May 2020 from https://phys.org/news/2020-04-photon-counting-camera-captures-d-images.html
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.
140 shares

Feedback to editors

User comments