Affordable camera reveals hidden details invisible to the naked eye

October 15, 2015
Compared to an image taken with a normal camera (left), HyperCam images (right) reveal detailed vein and skin texture patterns that are unique to each individual. Credit: University of Washington

Peering into a grocery store bin, it's hard to tell if a peach or tomato or avocado is starting to go bad underneath its skin.

But an affordable technology being developed by the University of Washington and Microsoft Research might enable consumers of the future to tell which piece of fruit is perfectly ripe or what's rotting in the fridge.

The team of and electrical engineers developed HyperCam, a lower-cost hyperspectral camera that uses both visible and invisible near-infrared light to "see" beneath surfaces and capture unseen details. This type of camera is typically used in industrial applications and can cost between several thousand to tens of thousands of dollars.

In a paper presented at the UbiComp 2015 conference, the team detailed a hardware solution that costs roughly $800, or potentially as little as $50 to add to a mobile phone camera. They also developed intelligent software that easily finds "hidden" differences between what the hyperspectral camera captures and what can be seen with the naked eye.

When HyperCam captured images of a person's hand, for instance, they revealed detailed vein and skin texture patterns that are unique to that individual. That can aid in everything from gesture recognition to biometrics to distinguishing between two different people playing the same video game.

As a preliminary investigation of HyperCam's utility as a biometric tool, in a test of 25 different users, the system was able differentiate between hand images of users with 99 percent accuracy.

In another test, the team also took hyperspectral images of 10 different fruits, from strawberries to mangoes to avocados, over the course of a week. The HyperCam images predicted the relative ripeness of the fruits with 94 percent accuracy, compared with only 62 percent for a typical camera.

The video will load shortly
In this time-lapse video, HyperCam is able to penetrate the tough skin of an avocado to show how it ripens over a week. The changes are not evident in the images taken by a normal RGB camera. Credit: University of Washington

"It's not there yet, but the way this hardware was built you can probably imagine putting it in a mobile phone," said Shwetak Patel, Washington Research Foundation Endowed Professor of Computer Science & Engineering and Electrical Engineering at the UW.

"With this kind of camera, you could go to the grocery store and know what produce to pick by looking underneath the skin and seeing if there's anything wrong inside. It's like having a food safety app in your pocket," Patel said.

Hyperspectral imaging is used today in everything from satellite imaging and energy monitoring to infrastructure and food safety inspections, but the technology's high cost has historically limited its use to industrial or commercial purposes. The UW and Microsoft Research team wanted to see if they could make a relatively simple and affordable hyperspectral camera for consumer uses.

"Existing systems are costly and hard to use, so we decided to create an inexpensive hyperspectral camera and explore these uses ourselves," said Neel Joshi, a Microsoft researcher who collaborated on the project. "After building the camera we just started pointing it at everyday objects—really anything we could find in our homes and offices—and we were amazed at all the hidden information it revealed."

A typical camera divides visible light into three bands—red, green and blue—and generates images using different combinations of those colors. But cameras that utilize other wavelengths in the electromagnetic spectrum can reveal invisible differences.

Near-infrared cameras, for instance, can reveal whether crops are healthy or a work of art is genuine. Thermal infrared cameras can visualize where heat is escaping from leaky windows or an overloaded electrical circuit.

The video will load shortly
HyperCam uses 17 different wavelengths along the electromagnetic spectrum to illuminate a scene and reveal differences that are invisible to the naked eye. Credit: University of Washington

"When you look at a scene with a naked eye or a normal camera, you're mostly seeing colors. You can say, 'Oh, that's a pair of blue pants,'" said lead author Mayank Goel, a UW computer science and engineering doctoral student and Microsoft Research graduate fellow. "With a hyperspectral camera, you're looking at the actual material that something is made of. You can see the difference between blue denim and blue cotton."

HyperCam, which uses the visible and near-infrared parts of the electromagnetic spectrum, illuminates a scene with 17 different wavelengths and generates an image for each.

One challenge in hyperspectral imaging is sorting through the sheer volume of frames produced. The UW software analyzes the images and finds ones that are most different from what the naked eye sees, essentially zeroing in on ones that the user is likely to find most revealing.

"It mines all the different possible images and compares it to what a normal camera or the human eye will see and tries to figure out what scenes look most different," Goel said.

One remaining challenge is that the technology doesn't work particularly well in bright light, Goel said. Next research steps will include addressing that problem and making the camera small enough to be incorporated into mobile phones and other devices, he said.

Explore further: Revealing faded frescos

Related Stories

Revealing faded frescos

July 1, 2015

Many details of the wall and ceiling frescos in the cloister of Brandenburg Cathedral have faded: Plaster on which horses once "galloped" appears more or less bare. A hyperspectral camera sees images that remain hidden to ...

Airborne imaging could revolutionise agriculture

September 10, 2013

An airborne camera capable of photographing the condition of certain crops over many acres of land could provide agriculturalists with the information they need to improve production. This is because, instead of simply recording ...

Image: Pluto's blue sky

October 9, 2015

Pluto's haze layer shows its blue color in this picture taken by the New Horizons Ralph/Multispectral Visible Imaging Camera (MVIC). The high-altitude haze is thought to be similar in nature to that seen at Saturn's moon ...

Recommended for you

Making it easier to collaborate on code

October 26, 2016

Git is an open-source system with a polarizing reputation among programmers. It's a powerful tool to help developers track changes to code, but many view it as prohibitively difficult to use.

Dutch unveil giant vacuum to clean outside air

October 25, 2016

Dutch inventors Tuesday unveiled what they called the world's first giant outside air vacuum cleaner—a large purifying system intended to filter out toxic tiny particles from the atmosphere surrounding the machine.


Adjust slider to filter visible comments by rank

Display comments: newest first

1 / 5 (1) Oct 15, 2015
Didn't Sony have a camera that could record part of the IR spectrum? And didn't Sony have to stop selling that camera because, in effect, it could photograph people as if they were not wearing suitable clothing? As if by magic, what is old becomes new again.
5 / 5 (3) Oct 15, 2015
Hyperspectral imaging is not the same as near-IR imaging, though most hyperspectral cameras do image a portion of the near-IR. As the article clearly stated, this hyperspectral camera shoots 17 separate images- one each at a different wavelength across the NIR-visible range. So no, this is something very different than the Sony Nightshot.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.