InSight team's wearable glass system identifies people by clothes

Mar 10, 2013 by Nancy Owano report
Sketch ofInSight: Bob’s phone announces his own name and fingerprint to the vicinity; Alice’s phone computes fingerprints from her glass, matches them against the ones received from the vicinity, and recognizes Bob. Credit: He Wang et al

( —Researchers from the University of South Carolina and Duke are proposing a "visual fingerprint" app that can be used with smartphones and wearable camera displays such as Google Glass. Their paper, "Recognizing Humans without Face Recognition," explored techniques that can jointly leverage camera-enabled glasses, an offering that is still in the wings, and phones, to pick out any individual based on what the person is wearing. The team behind the InSight project developed and tested a prototype system that can pick out people by their clothes and other accessories. Once identified, the person's name would be displayed on the headset.

The system was developed by Srihari Nelakuditi, associate professor of and engineering at the University of South Carolina, along with three colleagues at Duke University, He Wang, Xuan Bao, and Romit Roy Choudhury.

How InSight works: A app creates a person's "fingerprint" by taking a series of pictures of the person. The app creates a file called a spatiogram that records the colors and patterns of the person's clothing. The camera display uses the combination to identify the person. (The researchers define spatiograms as color histograms with spatial distributions encoded. Basic color histograms only capture the relative frequency of each color, but spatiograms capture how these colors are distributed in 2-D space.)

What's the point of the app? One advantage would be if a person wanted to more easily find friends in crowded places such as airports and arenas, where people become separated from each other or have their backs turned so that faces cannot easily be seen.

The researchers suggest another use case where "Alice" may look at people around her in a social gathering and see the names of each individual like a virtual badge suitably overlaid on her wearable display.

What's the limitation? Once the individual changes clothes or accessories, InSight identification is impossible. The app would be useful for a day, for example, or part of the day.

To develop their prototype, the researchers used PivotHead camera-enabled glasses and Samsung Galaxy phones running Android. They conducted experiments with 15 users. They asked participants to actively use their smartphones. InSight could identify people 93 per cent of the time, even when they had their backs turned. The researchers' key intent in this exercise was to pursue a hypothesis that colors and patterns on clothes may pose as a human "fingerprint." Their investigation suggested that clothes can be matched with reasonable accuracy. Their work is ongoing, and will focus on incremental deployment, they said, as well as exploring motion patterns when "visual fingerprints" are not unique. "We believe there is promise, and are committed to building a fuller, real-time, system."

Explore further: Innovative new supercomputers increase nation's computational capacity and capability

More information: InSight: Recognizing Humans without Face Recognition, by He Wang et al.:

Related Stories

Potential drunk drivers now have an app for that

Jan 09, 2012

( -- You have spent the night out on the town and had a few drinks with friends. At the end of the evening, you figure you have only had a few drinks. You should be fine to drive right? While this ...

WalkSafe app shields smartphone pedestrians (w/ video)

Nov 28, 2011

( -- Smartphone users who as pedestrians are not very smart about crossing and looking both ways now have a protective shield in the form of an Android app which they can download for free. A research ...

Google patent sends ring signals to Project Glass

May 19, 2012

( -- Google's September 2011 patent that was filed for a wearable display device was granted this week, which suggests that its envisioned heads-up display device can be controlled by infrared markers ...

Recommended for you

Forging a photo is easy, but how do you spot a fake?

Nov 21, 2014

Faking photographs is not a new phenomenon. The Cottingley Fairies seemed convincing to some in 1917, just as the images recently broadcast on Russian television, purporting to be satellite images showin ...

Algorithm, not live committee, performs author ranking

Nov 21, 2014

Thousands of authors' works enter the public domain each year, but only a small number of them end up being widely available. So how to choose the ones taking center-stage? And how well can a machine-learning ...

Professor proposes alternative to 'Turing Test'

Nov 19, 2014

( —A Georgia Tech professor is offering an alternative to the celebrated "Turing Test" to determine whether a machine or computer program exhibits human-level intelligence. The Turing Test - originally ...

User comments : 2

Adjust slider to filter visible comments by rank

Display comments: newest first

5 / 5 (1) Mar 10, 2013
Sounds like an interesting idea but I wouldn't have used colours as an identifier. Why not use measurements that don't change too much?
Someone's height, someones body structure or maybe add in hair colour?
1 / 5 (2) Mar 10, 2013
Is this the reason that Western Europe wants to ban all porn? Google is the new pope!

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.