Computer sees your hipster haircut, sells you a plaid shirt

Dec 18, 2013 by Matthew Higgs, The Conversation
It looks like you’re playing a ukulele. Would you like to buy some quinoa? Credit: Lilah Shepherd

Researchers at the University of California, San Diego, are developing an algorithm that aims to identify whether you're a hipster, a goth or a punk, just from the cut of your social media jib.

The team has been analysing pictures of groups of people in an attempt to place them within one of eight sub-cultures according to their appearance. These included hipsters, goths, surfers and bikers.

By looking out for trendy haircuts, telltale tattoos and jewellery, the algorithm is being trained to make assumptions about you based for example on your pictures.

Websites can then offer you a more tailored experience. A surfer might be given recommendations about holidays and a punk updated on gigs for their favourite band. And what better way for a hipster to make sure they stay ahead of the curve than to be updated on the very latest in organic, fairtrade coffee products, as and when they come on the market?

How it works

The researchers are using what is known as a multi-label classification algorithm. These are widely used in vision analysis to draw conclusions from clues that are found in images. It takes a set of photos, each with their own label, such as "cat", "car", "emo", and then finds the features in the photos that best predict the label of a new photo. The algorithm leverages the assumption that pictures with a similar set of feature values are likely to have similar labels.

So if it looks at a picture, sees a pair of horn-rimmed glasses, a waxed moustache and a lumberjack shirt, and is told that it is looking at a hipster, it can move on to a new photo and identify a quinoa lover just from their look.

Which is your tribe? Jacobs School of Engineering UC San Diego

The researchers say the algorithm is 48% accurate on average, while chance would get answers right only 9% of the time. If you were to guess the content of a picture (without seeing it), then you will guess the correct answer once every 11 times on average. This machine can do better than that but not as well as a human using the full power of their street savvy.

The algorithm uses a "parts and attributes" approach, by breaking down each picture into a set of feature values. In this case, features such as the head, neck, torso and arms of each subject were scanned for attributes such as tattoos, colours, haircuts and jewellery.

The algorithm then uses the labelled pictures to learn a classifier. This type of learning problem would be perfectly suited to the machinery of Google, in that it might be possible to find the features indicative of particular social groups without needing to manually state the types of features such as face, head, top of the head (where a hat would be), neck, torso and arms.

What it's for

The idea is that if an algorithm can identify the kind of person you are from how you look, sites can offer you a more personally tailored experience.

There are some problems to this approach though. For a start, a 48% accuracy means that a Facebooking goth would be fairly likely to get ads for fixed-wheel bike repairs cropping up in their feed by mistake were the technology be deployed in its current state. While 48% is better than chance, the researchers want their to perform as well as a human would and plan to keep working to improve its accuracy.

But then comes the deeper question of whether you can really make assumptions about what a person is interested in based on how they look. Just because a goth likes to dress in black doesn't necessarily mean their taste in hobbies isn't more closely aligned to those of a surfer.

We have to ask ourselves if we want our internet experience to be tailored in this way. Ads and search results that have been tailored according to our gender can already be irritating. Often is seems that Facebook thinks that just because a user is a woman, she will automatically be interested in news about celebrity diets.

While it may be useful to identify a user's tribe to understand them better, how that information is used depends on certain assumptions about what that tribe likes. As any hipster will tell you, that can change in an instant.

Explore further: Hipster, surfer or biker? Computers may soon be able to tell the difference

add to favorites email to friend print save as pdf

Related Stories

Oh great, Facebook wants to know you're being sarcastic

Sep 26, 2013

You might think social networks couldn't possibly gather more information on you than they already do. That in a world where your every move is tagged, flagged and logged, there is nothing more that could ...

New algorithm finds you, even in untagged photos

Dec 02, 2013

A new algorithm designed at the University of Toronto has the power to profoundly change the way we find photos among the billions on social media sites such as Facebook and Flickr. This month, the United ...

Recommended for you

Quantenna promises 10-gigabit Wi-Fi by next year

2 hours ago

(Phys.org) —Quantenna Communications has announced that it has plans for releasing a chipset that will be capable of delivering 10Gbps WiFi to/from routers, bridges and computers by sometime next year. ...

New US-Spanish firm says targets rich mobile ad market

2 hours ago

Spanish telecoms firm Telefonica and US investment giant Blackstone launched a mobile telephone advertising venture on Wednesday, challenging internet giants such as Google and Facebook in a multi-billion-dollar ...

Environmentally compatible organic solar cells

3 hours ago

Environmentally compatible production methods for organic solar cells from novel materials are in the focus of "MatHero". The new project coordinated by Karlsruhe Institute of Technology (KIT) aims at making ...

Twitter rules out Turkey office amid tax row

3 hours ago

Social networking company Twitter on Wednesday rejected demands from the Turkish government to open an office there, following accusations of tax evasion and a two-week ban on the service.

User comments : 2

Adjust slider to filter visible comments by rank

Display comments: newest first

Captain Stumpy
not rated yet Dec 19, 2013
LMFAO
this algorithm would burn out trying to figure out me on my social web page ... especially given that there are NO pics of me on it!
cantdrive85
not rated yet Dec 19, 2013
LMFAO
this algorithm would burn out trying to figure out me on my social web page ... especially given that there are NO pics of me on it!


Me too, being I don't have a social webpage.

More news stories

Quantenna promises 10-gigabit Wi-Fi by next year

(Phys.org) —Quantenna Communications has announced that it has plans for releasing a chipset that will be capable of delivering 10Gbps WiFi to/from routers, bridges and computers by sometime next year. ...

Unlocking secrets of new solar material

(Phys.org) —A new solar material that has the same crystal structure as a mineral first found in the Ural Mountains in 1839 is shooting up the efficiency charts faster than almost anything researchers have ...

Floating nuclear plants could ride out tsunamis

When an earthquake and tsunami struck the Fukushima Daiichi nuclear plant complex in 2011, neither the quake nor the inundation caused the ensuing contamination. Rather, it was the aftereffects—specifically, ...

New US-Spanish firm says targets rich mobile ad market

Spanish telecoms firm Telefonica and US investment giant Blackstone launched a mobile telephone advertising venture on Wednesday, challenging internet giants such as Google and Facebook in a multi-billion-dollar ...