Hipster, surfer or biker? Computers may soon be able to tell the difference

Hipster, surfer or biker? Computers may soon be able to tell the difference

(Phys.org) —Are you a hipster, surfer or biker? What is your urban tribe? Your computer may soon be able to tell. Computer scientists at the University of California, San Diego, are developing an algorithm that uses group pictures to determine to which of these groups, or urban tribes, you belong. So far, the algorithm is 48 percent accurate on average. That's better than chance—which gets answers right only nine percent of the time—but researchers would like the algorithm perform at least as well as humans would.

An algorithm able to identify people's urban tribes would have a wide range of applications, from generating more relevant search results and ads, to allowing social networks to provide better recommendations and content. There also is a growing interest in analyzing footage from cameras installed in public spaces to identify groups rather than individuals.

Computer scientists presented their findings at the British Machine Vision Conference in the United Kingdom this fall.

"This is a first step," said Serge Belongie, a professor at the Jacobs School of Engineering at the University of California, San Diego, and co-author of the study. "We are scratching the surface to figure out what the signals are."

This is an extremely difficult problem, Belongie explained, and a 48 percent accuracy rate is actually a very good result. One of the researchers' insights was to look at group pictures rather than pictures of individuals. They hoped that this would make it easier to pick up social cues, such as clothing and hairdos, to determine people's tribes based on visuals featuring more than one person.

Hipster, surfer or biker? Computers may soon be able to tell the difference
Examples of social groups in the researchers' Urban Tribes dataset.

While humans can recognize urban tribes at a glance, computers cannot. So the algorithm segments each person in six sections—face, head, top of the head (where a hat would be), neck, torso and arms. This method is an example of what's better known as a "parts and attributes" approach. Computer scientists designed the algorithm to analyze the picture as the sum of its parts and attributes—in this case haircuts, hair color, make up, jewelry and tattoos, for example. The algorithm also analyzes the boxes for color, texture and other factors.

Researchers then let data do the work, feeding the algorithm pictures labeled for the urban tribes they represent—hipsters, surfers, bikers, Goth, etc.—a common machine learning technique. Finally, they fed the pictures without labels. The computer vision program accurately determined to which urban tribe the pictures belonged 48 percent of the time—better than random. The researcher's next step is to run the same set of pictures by human users and see how they perform.

In addition, the UC San Diego researchers are working with Lubomir Bourdev, a fomer Ph.D. science student at UC Berkeley, and Peter Belhumeur from the Department of Computer Science at Columbia University to improve the analysis of facial features and other attributes within the system.

To define urban tribes in the study, turned to Wikipedia and selected the eight most popular categories in the encyclopedia's list of subcultures: biker, country, Goth, heavy metal, hip hop, hipster, raver and surfer. They also included photographs from three common categories for social venues: formal events, dance clubs and casual pubs.

A by-product of their research was the development of an extensive dataset of urban tribe pictures, including hundreds of images, which they plan to make available to other research groups.

Explore further

New algorithm finds you, even in untagged photos

Citation: Hipster, surfer or biker? Computers may soon be able to tell the difference (2013, December 11) retrieved 19 October 2019 from https://phys.org/news/2013-12-hipster-surfer-biker-difference.html
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

Feedback to editors

User comments

Dec 11, 2013
Oh snap! civilization has ended as we know it. When these transient vaguely collective whims we call 'urban tribes' have blown in they have blown out just as quickly which gives humanity the opportunity to make progress, more or less, in the interspaces between tribes. All tribes are cultural dead-ends unless we encode them into the backbone of the Internet at which point humanity becomes a cultural dead-end itself. Not that we perish, but that we loose the ability to be socially conscious without technology. Fkn'nightmare!

[added] Heck, I guess it's already gone now that I think of it - (the ability to "be" without "tech" in a personal sense). Perhaps I'm only a modern Luddite. They were lamenting the loss of work as a social mechanism to interpret the human experience, and I might be alarmist, but this seems more like the loss of human experience as a mechanism to interpret human experience. it'snotarantit'sableetandaplea

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more