Hipster, surfer or biker? Computers may soon be able to tell the difference

Dec 11, 2013 by Ioana Patringenaru

(Phys.org) —Are you a hipster, surfer or biker? What is your urban tribe? Your computer may soon be able to tell. Computer scientists at the University of California, San Diego, are developing an algorithm that uses group pictures to determine to which of these groups, or urban tribes, you belong. So far, the algorithm is 48 percent accurate on average. That's better than chance—which gets answers right only nine percent of the time—but researchers would like the algorithm perform at least as well as humans would.

An algorithm able to identify people's urban tribes would have a wide range of applications, from generating more relevant search results and ads, to allowing social networks to provide better recommendations and content. There also is a growing interest in analyzing footage from cameras installed in public spaces to identify groups rather than individuals.

Computer scientists presented their findings at the British Machine Vision Conference in the United Kingdom this fall.

"This is a first step," said Serge Belongie, a professor at the Jacobs School of Engineering at the University of California, San Diego, and co-author of the study. "We are scratching the surface to figure out what the signals are."

This is an extremely difficult problem, Belongie explained, and a 48 percent accuracy rate is actually a very good result. One of the researchers' insights was to look at group pictures rather than pictures of individuals. They hoped that this would make it easier to pick up social cues, such as clothing and hairdos, to determine people's tribes based on visuals featuring more than one person.

Examples of social groups in the researchers' Urban Tribes dataset.

While humans can recognize urban tribes at a glance, computers cannot. So the algorithm segments each person in six sections—face, head, top of the head (where a hat would be), neck, torso and arms. This method is an example of what's better known as a "parts and attributes" approach. Computer scientists designed the algorithm to analyze the picture as the sum of its parts and attributes—in this case haircuts, hair color, make up, jewelry and tattoos, for example. The algorithm also analyzes the boxes for color, texture and other factors.

Researchers then let data do the work, feeding the algorithm pictures labeled for the urban tribes they represent—hipsters, surfers, bikers, Goth, etc.—a common machine learning technique. Finally, they fed the pictures without labels. The computer vision program accurately determined to which urban tribe the pictures belonged 48 percent of the time—better than random. The researcher's next step is to run the same set of pictures by human users and see how they perform.

In addition, the UC San Diego researchers are working with Lubomir Bourdev, a fomer Ph.D. science student at UC Berkeley, and Peter Belhumeur from the Department of Computer Science at Columbia University to improve the analysis of facial features and other attributes within the system.

To define urban tribes in the study, turned to Wikipedia and selected the eight most popular categories in the encyclopedia's list of subcultures: biker, country, Goth, heavy metal, hip hop, hipster, raver and surfer. They also included photographs from three common categories for social venues: formal events, dance clubs and casual pubs.

A by-product of their research was the development of an extensive dataset of urban tribe pictures, including hundreds of images, which they plan to make available to other research groups.

Explore further: New algorithm finds you, even in untagged photos

Related Stories

New algorithm finds you, even in untagged photos

Dec 02, 2013

A new algorithm designed at the University of Toronto has the power to profoundly change the way we find photos among the billions on social media sites such as Facebook and Flickr. This month, the United ...

Recommended for you

User comments : 1

Adjust slider to filter visible comments by rank

Display comments: newest first

loneislander
3 / 5 (2) Dec 11, 2013
Oh snap! civilization has ended as we know it. When these transient vaguely collective whims we call 'urban tribes' have blown in they have blown out just as quickly which gives humanity the opportunity to make progress, more or less, in the interspaces between tribes. All tribes are cultural dead-ends unless we encode them into the backbone of the Internet at which point humanity becomes a cultural dead-end itself. Not that we perish, but that we loose the ability to be socially conscious without technology. Fkn'nightmare!

[added] Heck, I guess it's already gone now that I think of it - (the ability to "be" without "tech" in a personal sense). Perhaps I'm only a modern Luddite. They were lamenting the loss of work as a social mechanism to interpret the human experience, and I might be alarmist, but this seems more like the loss of human experience as a mechanism to interpret human experience. it'snotarantit'sableetandaplea

More news stories

Ex-Apple chief plans mobile phone for India

Former Apple chief executive John Sculley, whose marketing skills helped bring the personal computer to desktops worldwide, says he plans to launch a mobile phone in India to exploit its still largely untapped ...

Airbnb rental site raises $450 mn

Online lodging listings website Airbnb inked a $450 million funding deal with investors led by TPG, a source close to the matter said Friday.

Health care site flagged in Heartbleed review

People with accounts on the enrollment website for President Barack Obama's signature health care law are being told to change their passwords following an administration-wide review of the government's vulnerability to the ...

A homemade solar lamp for developing countries

(Phys.org) —The solar lamp developed by the start-up LEDsafari is a more effective, safer, and less expensive form of illumination than the traditional oil lamp currently used by more than one billion people ...

NASA's space station Robonaut finally getting legs

Robonaut, the first out-of-this-world humanoid, is finally getting its space legs. For three years, Robonaut has had to manage from the waist up. This new pair of legs means the experimental robot—now stuck ...

Filipino tests negative for Middle East virus

A Filipino nurse who tested positive for the Middle East virus has been found free of infection in a subsequent examination after he returned home, Philippine health officials said Saturday.

Egypt archaeologists find ancient writer's tomb

Egypt's minister of antiquities says a team of Spanish archaeologists has discovered two tombs in the southern part of the country, one of them belonging to a writer and containing a trove of artifacts including reed pens ...