Human skin detection technology for improved security, search and rescue

December 10, 2015
The Air Force Institute of Technology's skin detection research is a key element in supporting security and search and rescue operations. Credit: M. Mendenhall/Air Force Institute of Technology (AFIT)

Color-image based systems are excellent at locating people in aerial search and rescue operations, but fall short when it comes to discerning between actual human skin and objects with similar hues. To remedy this, researchers at the Air Force Institute of Technology (AFIT) have developed a novel two-dimensional feature space which uses the spectral absorption characteristics of melanin, hemoglobin and water to better characterize human skin.

Spectral imaging systems use information from the entire electromagnetic spectrum to provide digital images with much greater information per pixel than traditional cameras. Feature spaces in a spectral imaging system are vectors that numerically represent an object's characteristics. The detection approach is described this week in Applied Optics, a journal from The Optical Society.

In their work, the AFIT research team used feature spaces to key in on specific constituents of human tissue by using a skin index concerned with how water and melanin's presence in skin manifests at two different wavelengths in the near-infrared region. These changes would cut the overall cost of hyperspectral-based search and rescue systems by a factor of seven.

"The study represents a crossroads between physics and statistical pattern recognition," said Michael J. Mendenhall, assistant professor, Air Force Institute of Technology, Department of Electrical and Computer Engineering, Dayton, Ohio, USA. "The features were designed based on an understanding of the physics behind skin's spectral shape, but in such a way that the features separated skin and non-skin pixels in order to make the pattern recognition portion of the problem more effective."

"After a lot of investigation into spectral properties of false alarm sources, we arrived at a simple observation that skin is more red than green, due to the melanin in darker skin and oxygenated hemoglobin in lighter skin, whereas many of the false alarm sources were more green than red," Mendenhall said.

Many current image recognition programs employ hyperspectral imaging systems, which allow engineers to search for a wide variety of objects—exoplanets, oil wells, or , to name a few - by looking for specific "fingerprints" in the electromagnetic spectrum. However, the involved image acquisition and post-processing are typically too slow for live search and . Additionally, specific air platform requirements and the high cost of acquisition and management—around $700,000—currently puts hyperspectral systems out of reach for search and rescue organizations.

Mendenhall and his colleagues use their skin detection and false alarm suppression feature space to design an application-specific optical system using three framing cameras; their first breadboard system is about 12"x12"x6". Because their skin detection solution can be implemented with less expensive technology capable of live video frame rates, its total price tag would be around $100,000.

Future work for Mendenhall and his colleagues includes investigating the scattering properties of hair in order to characterize pixels as a mix of skin and hair, as well as improving the rates of their system by accounting for skin's specular, or mirror-like, reflection of light.

Explore further: Seeing your true colors: Standards for hyperspectral imaging

More information: M. Mendenhall, A. Nunez, R. Martin, "Human skin detection in the visible and near infrared," Applied Optics 54, 10559-10570 (2015) … m?uri=ao-54-35-10559

Related Stories

Recommended for you

Carefully crafted light pulses control neuron activity

November 17, 2017

Specially tailored, ultrafast pulses of light can trigger neurons to fire and could one day help patients with light-sensitive circadian or mood problems, according to a new study in mice at the University of Illinois.

Strain-free epitaxy of germanium film on mica

November 17, 2017

Germanium, an elemental semiconductor, was the material of choice in the early history of electronic devices, before it was largely replaced by silicon. But due to its high charge carrier mobility—higher than silicon by ...

New imaging technique peers inside living cells

November 16, 2017

To undergo high-resolution imaging, cells often must be sliced and diced, dehydrated, painted with toxic stains, or embedded in resin. For cells, the result is certain death.

The stacked color sensor

November 16, 2017

Red-sensitive, blue-sensitive and green-sensitive color sensors stacked on top of each other instead of being lined up in a mosaic pattern – this principle could allow image sensors with unprecedented resolution and sensitivity ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.