Algorithm makes hyperspectral imaging faster

February 18, 2016 by Matt Shipman, North Carolina State University
Algorithm makes hyperspectral imaging faster
Images at wavelengths from 470 nm to 632 nm within image cubes reconstructed by the new algorithm and another state-of-art algorithm for the LEGO image cube. The top row represents the ground truth; the middle row shows the output of the new algorithm; and the bottom row shows the output of the other algorithm.

Researchers from North Carolina State University and the University of Delaware have developed an algorithm that can quickly and accurately reconstruct hyperspectral images using less data. The images are created using instruments that capture hyperspectral information succinctly, and the combination of algorithm and hardware makes it possible to acquire hyperspectral images in less time and to store those images using less memory.

Hyperspectral imaging holds promise for use in fields ranging from security and defense to environmental monitoring and agriculture.

Conventional imaging techniques, such as digital photography, capture images across only three wavelengths – or frequencies – of light, from blue to green to red. Hyperspectral imaging creates images across dozens or hundreds of wavelengths. These images can be used to determine the materials found in whatever scene was imaged – sort of like spectroscopy done at a distance.

But the technique does face some challenges.

For example, in a conventional imaging system, if an image has millions of pixels across three wavelengths, the image file might be one megabyte. But in , the image file could be at least an order of magnitude larger. This can create problems for storing and transmitting data.

In addition, capturing hyperspectral images across dozens of wavelengths can be time-consuming – with the conventional imaging technology taking a series of images, each capturing a different suite of wavelengths, and then combining them.

Runtime versus average peak signal to noise ratio (PSNR) for the new algorithm (the blue line), compared to two other state-of-art algorithms for the Lego image cube shown above.
"It can take minutes," says Dror Baron, an assistant professor of electrical and computer engineering at NC State and one of the senior authors of a paper describing the new .

In recent years, researchers have developed new hyperspectral imaging hardware that can acquire the necessary images more quickly and store the using significantly less memory. The hardware takes advantage of "compressive measurements," which mix spatial and data in a format that can be used later to reconstruct the complete hyperspectral image.

But in order for the new hardware to work effectively, you need an algorithm that can reconstruct the image accurately and quickly. And that's what researchers at NC State and Delaware have developed.

In model testing, the significantly outperformed existing algorithms at every frequency.

"We were able to reconstruct image quality in 100 seconds of computation that other algorithms couldn't match in 450 seconds," Baron says. "And we're confident that we can bring that computational time down even further."

The higher quality of the image reconstruction means that fewer measurements need to be acquired and processed by the hardware, speeding up the imaging time. And fewer measurements mean less data that needs to be stored and transmitted.

"Our next step is to run the algorithm in a real world system to gain insights into how the algorithm functions and identify potential room for improvement," Baron says. "We're also considering how we could modify both the algorithm and the to better compliment each other."

Explore further: Researchers release open source code for powerful image detection algorithm

More information: Jin Tan et al. Compressive Hyperspectral Imaging via Approximate Message Passing, IEEE Journal of Selected Topics in Signal Processing (2016). DOI: 10.1109/JSTSP.2015.2500190

Related Stories

Algorithm helps turn smartphones into 3-D scanners

December 22, 2015

While 3-D printers have become relatively cheap and available, 3-D scanners have lagged well behind. But now, an algorithm developed by Brown University researchers my help bring high-quality 3-D scanning capability to off-the-shelf ...

Revealing faded frescos

July 1, 2015

Many details of the wall and ceiling frescos in the cloister of Brandenburg Cathedral have faded: Plaster on which horses once "galloped" appears more or less bare. A hyperspectral camera sees images that remain hidden to ...

Recommended for you

Coffee-based colloids for direct solar absorption

March 22, 2019

Solar energy is one of the most promising resources to help reduce fossil fuel consumption and mitigate greenhouse gas emissions to power a sustainable future. Devices presently in use to convert solar energy into thermal ...

EPA adviser is promoting harmful ideas, scientists say

March 22, 2019

The Trump administration's reliance on industry-funded environmental specialists is again coming under fire, this time by researchers who say that Louis Anthony "Tony" Cox Jr., who leads a key Environmental Protection Agency ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.