# Computer sees your hipster haircut, sells you a plaid shirt

##### December 18, 2013 by Matthew Higgs, The Conversation

Researchers at the University of California, San Diego, are developing an algorithm that aims to identify whether you're a hipster, a goth or a punk, just from the cut of your social media jib.

The team has been analysing pictures of groups of people in an attempt to place them within one of eight sub-cultures according to their appearance. These included hipsters, goths, surfers and bikers.

By looking out for trendy haircuts, telltale tattoos and jewellery, the algorithm is being trained to make assumptions about you based for example on your pictures.

Websites can then offer you a more tailored experience. A surfer might be given recommendations about holidays and a punk updated on gigs for their favourite band. And what better way for a hipster to make sure they stay ahead of the curve than to be updated on the very latest in organic, fairtrade coffee products, as and when they come on the market?

How it works

The researchers are using what is known as a multi-label classification algorithm. These are widely used in vision analysis to draw conclusions from clues that are found in images. It takes a set of photos, each with their own label, such as "cat", "car", "emo", and then finds the features in the photos that best predict the label of a new photo. The algorithm leverages the assumption that pictures with a similar set of feature values are likely to have similar labels.

So if it looks at a picture, sees a pair of horn-rimmed glasses, a waxed moustache and a lumberjack shirt, and is told that it is looking at a hipster, it can move on to a new photo and identify a quinoa lover just from their look.

The researchers say the algorithm is 48% accurate on average, while chance would get answers right only 9% of the time. If you were to guess the content of a picture (without seeing it), then you will guess the correct answer once every 11 times on average. This machine can do better than that but not as well as a human using the full power of their street savvy.

The algorithm uses a "parts and attributes" approach, by breaking down each picture into a set of feature values. In this case, features such as the head, neck, torso and arms of each subject were scanned for attributes such as tattoos, colours, haircuts and jewellery.

The algorithm then uses the labelled pictures to learn a classifier. This type of learning problem would be perfectly suited to the machinery of Google, in that it might be possible to find the features indicative of particular social groups without needing to manually state the types of features such as face, head, top of the head (where a hat would be), neck, torso and arms.

What it's for

The idea is that if an algorithm can identify the kind of person you are from how you look, sites can offer you a more personally tailored experience.

There are some problems to this approach though. For a start, a 48% accuracy means that a Facebooking goth would be fairly likely to get ads for fixed-wheel bike repairs cropping up in their feed by mistake were the technology be deployed in its current state. While 48% is better than chance, the researchers want their to perform as well as a human would and plan to keep working to improve its accuracy.

But then comes the deeper question of whether you can really make assumptions about what a person is interested in based on how they look. Just because a goth likes to dress in black doesn't necessarily mean their taste in hobbies isn't more closely aligned to those of a surfer.

We have to ask ourselves if we want our internet experience to be tailored in this way. Ads and search results that have been tailored according to our gender can already be irritating. Often is seems that Facebook thinks that just because a user is a woman, she will automatically be interested in news about celebrity diets.

While it may be useful to identify a user's tribe to understand them better, how that information is used depends on certain assumptions about what that tribe likes. As any hipster will tell you, that can change in an instant.

## Related Stories

#### Hipster, surfer or biker? Computers may soon be able to tell the difference

December 11, 2013

(Phys.org) —Are you a hipster, surfer or biker? What is your urban tribe? Your computer may soon be able to tell. Computer scientists at the University of California, San Diego, are developing an algorithm that uses group ...

#### Oh great, Facebook wants to know you're being sarcastic

September 26, 2013

You might think social networks couldn't possibly gather more information on you than they already do. That in a world where your every move is tagged, flagged and logged, there is nothing more that could possibly be gleaned ...

#### New algorithm finds you, even in untagged photos

December 2, 2013

A new algorithm designed at the University of Toronto has the power to profoundly change the way we find photos among the billions on social media sites such as Facebook and Flickr. This month, the United States Patent and ...

#### New algorithm uses subtle changes to make a face more memorable without changing a person's overall appearance

December 17, 2013

Do you have a forgettable face? Many of us go to great lengths to make our faces more memorable, using makeup and hairstyles to give ourselves a more distinctive look.

#### Algorithm developed to guide physicians in obesity care

October 16, 2013

(HealthDay)—An algorithm has been developed to help physicians navigate medical treatment for obesity care, according to a report published by the American Society of Bariatric Physicians (ASBP).

#### Love connection: Researchers develop algorithm for recommending online dating prospects

December 5, 2013

University of Iowa researchers may have come up with the right matchmaking formula for online dating sites: Pair people according to their past interests and online mating success, rather than who they say they're interested ...

## Recommended for you

#### Army's brain-like computers moving closer to cracking codes

March 22, 2018

U.S. Army Research Laboratory scientists have discovered a way to leverage emerging brain-like computer architectures for an age-old number-theoretic problem known as integer factorization.

March 21, 2018

Breaking more than four days of silence, Facebook CEO Mark Zuckerberg admitted mistakes and outlined steps to protect user data in light of a privacy scandal involving a Trump-connected data-mining firm.

#### New artificial intelligence technique dramatically improves the quality of medical imaging

March 21, 2018

A radiologist's ability to make accurate diagnoses from high-quality diagnostic imaging studies directly impacts patient outcome. However, acquiring sufficient data to generate the best quality imaging comes at a cost - increased ...

#### Depth-sensing imaging system can peer through fog

March 21, 2018

MIT researchers have developed a system that can produce images of objects shrouded by fog so thick that human vision can't penetrate it. It can also gauge the objects' distance.

#### AMD says patches on the way for flawed chips

March 21, 2018

Advanced Micro Devices on Tuesday said patches are on the way for recently revealed flaws in some of its chips that could allow hackers to take over computers.

#### Self-driving vehicle strikes and kills pedestrian in Arizona (Update)

March 19, 2018

A self-driving Uber SUV struck and killed a pedestrian in suburban Phoenix in the first death involving a fully autonomous test vehicle—a crash that could have far-reaching consequences for the new technology.

##### Captain Stumpy
not rated yet Dec 19, 2013
LMFAO
this algorithm would burn out trying to figure out me on my social web page ... especially given that there are NO pics of me on it!
##### cantdrive85
not rated yet Dec 19, 2013
LMFAO
this algorithm would burn out trying to figure out me on my social web page ... especially given that there are NO pics of me on it!

Me too, being I don't have a social webpage.