Advertisers look with empathy into your front room

February 3, 2014 by Andrew Mcstay, The Conversation
Someone’s about to get sold a Lucozade. Credit: adwriter

Technology is under development to enable advertisers to target products not just at a broad group of people that might be watching a certain type of programme but at specific households and even individuals.

By gathering information about what you watch and do in your front room, they can decide which adverts will have the most traction. It's an advertisers dream to broadcast to an audience of one and we are ever closer to this becoming reality.

In the UK, the charge is being led by Sky, which says that Tesco, the Royal Bank of Scotland, Littlewoods, American Airlines, Audi, Citroen and Dial-A-Flight will all use its AdSmart services.

A window on your world

Their efforts are, in part, made possible by the fact that there are now many more ways to watch televisual content than on televisions, such as online via Netflix or catch-up services. The cookies we leave behind when we watch all help those providing the programmes build up a picture of what you like and what you watch. That's pure gold for advertisers.

But we also connect our TVs to different devices, such as Xboxes, which will offer a window into our world like never before. An Xbox enables advertisers to target content at you based on your subscriber information, such as your age, gender and address.

These devices can also see into your living room. Sensors in an Xbox make it possible to play games without a controller in your hand because they can scan the content of the room and identify how many people are in it. That, in turn, means advertisers can gather the information and deliver even more refined advertising. Spooked yet? Well, there's more.

Verizon's big play

If you have time to spare, it can be illuminating to search for the patent applications of technology companies. I did, and found a fascinating application by telecommunications company Verizon to the US patents office, titled Methods and Systems for Presenting an Advertisement Associated with an Ambient Action of a Use. This shows that the company has patented a suite of technologies that would trigger tailored advertisements based on whether viewers are eating, playing, cuddling, laughing, singing, fighting, talking or gesturing in front of their sets. Cuddling, for example, might trigger advertisements for a trip to Paris.

It might seem like an incredible leap but the ability to make assessments about you comes from technologies that we are gradually becoming accustomed to already. Motion capture and analysis technologies, gesture recognition technologies, facial recognition technologies, voice and acoustic source localisation technologies all combine to build an accurate picture of who you are and what you are doing.

It's not just the fact that you are moving or speaking but the gestures you make and the mannerisms you display. It's your physical attributes and the tone and inflection of your voice. It's the language you speak or the accent you have and it's your proximity to others.

And, it's not just people. Pets, products, brands, decorative style, objects such as pictures and photographs can also be scanned and profiled. If your TV picks up a small furry shape moving around your feet, it may start pushing cat food at you.

Verizon's set-top box will determine which people present are adults by linking what information it has in its user profiles with variables such as physical appearance and voice attributes. Once it knows the tone of your voice and your mannerisms it could even guess your mood. This is yet more valuable information for advertisers, who can suggest a holiday when you're feeling down or a DIY store when you're full of energy.

If you're humming a tune, Verizon plans to use a signal processing heuristic to identify the name and genre of the song. Very handy when music labels ask it to sell their latest releases.

And of course, if your TV can gather all this about you before it shows you an ad, it can monitor your response to that ad once you've seen it.

Then it can communicate with the mobile device or tablet you are using as you watch, sending ads to you while you browse and taking cookies back for future reference.

Empathy: the future of advertising

This all takes the idea of behavioural advertising quite literally. What's more, the TV, the advertising and the devices could even be said to be displaying a whole new characteristic: empathy.

And if they can empathise, we might have to revise how we think about the media.

It's important to note that empathy is quite distinct from sympathy. Empathy is a form of reading social cues and responding appropriately. It's about understanding others by watching, listening, sensing and making inferences about actions or inaction.

We do this without thinking as we assess how others are getting on, check people's current behaviour against past behaviour, and revise our actions toward others if we get an unwanted reaction. These are all actions being performed by this type of system.

The question is not one of intelligence or whether machines might act like people, but that people and machines (arguably along with animals) empathise in similar ways through responses to public behaviour. After all, when we humans empathise, we do not literally feel into the skulls of others, we read and respond to public signals. That's what empathic media is increasingly doing too.

As this technology edges towards the market, what people say, do and feel in the domestic sphere become increasingly public. The boundaries are being tested and the meaning of personal privacy redefined and, at least for now, it's the advertisers that are calling the shots.

Explore further: Facebook tests ads in outside mobile apps

Related Stories

Intel wants piece of TV biz via face time

June 10, 2012

( -- Technology industry giants are extending their lines of business from PCs, tablets and phones into owning a piece of the action of TV sets and content services. Apple and Google have got a lot of press over ...

Pay-per-gaze? Google patent proposes ad system

August 18, 2013

( —Advertising models could in the future expand from clicks to pupil dilations. Google's patent for a Gaze Tracking System became public last week. Originally filed in May 2011, the patent presents an idea for ...

Review: Xbox One nearly a set-top box replacement

December 4, 2013

The Xbox One won't quite replace your TV set-top box, but it comes awfully close. The latest game console from Microsoft takes a big leap toward being the main entertainment hub in your living room. It gives you a program ...

Google, Apple and other tech giants look to a post-cookie era

October 30, 2013

After nearly 20 years, the era of Web-based "cookies" appears headed for an end, as companies like Google Inc., Apple Inc. and Microsoft Corp. explore new ways to track Internet users' habits, from desktop PCs to smartphones ...

Recommended for you

US faces moment of truth on 'net neutrality'

December 14, 2017

The acrimonious battle over "net neutrality" in America comes to a head Thursday with a US agency set to vote to roll back rules enacted two years earlier aimed at preventing a "two-speed" internet.

The wet road to fast and stable batteries

December 14, 2017

An international team of scientists—including several researchers from the U.S. Department of Energy's (DOE) Argonne National Laboratory—has discovered an anode battery material with superfast charging and stable operation ...

Microbes help turn Greek yogurt waste into fuel

December 13, 2017

Consumers across the world enjoy Greek yogurt for its taste, texture, and protein-packed punch. Reaching that perfect formula, however, generates large volumes of food waste in the form of liquid whey. Now researchers in ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.