SHORE facial analysis spots emotions on Google Glass

Aug 28, 2014 by Nancy Owano weblog

One of the key concerns about facial recognition software has been over privacy. The very idea of having tracking mechanisms as part of an Internet-connected wearable would be likely to upset many privacy advocates. German researchers at the Fraunhofer Institute for Integrated Circuits IIS have worked on their facial recognition technology for Google Glass with a welcomed twist. Their result is that emotions, gender, and age can be recognized but—stop gagging—-not identity. "None of the images leaves the device," said the team behind the software. Sophisticated High-speed Object Recognition Engine (SHORE) is the name of the group's software, which processes video on the Google Glass CPU. All calculations are performed in real-time by the CPU. By participating in the Google Glass "Explorer Program" Fraunhofer IIS was able to test the smart eyewear. The Google Glass app was made possible by adapting and implementing the Fraunhofer IIS SHORE software library as Glassware.

A software library of data built on C++ analyzes the face. Information about the person—happy, sad, angry, surprised, age estimation, gender—is superimposed next to the face. SHORE can also do eye-blink estimation and valence (emotion) recognition.

The researchers said the database has over 10,000 annotated faces. In combination with structure-based features and learning algorithms, they said they can train so-called models that boast extremely high recognition rates.

CNET's Seth Rosenblatt said the organization sees SHORE as a communication aid for people, for example, on the autism spectrum who may have difficulties in identifying emotions. "Fraunhofer also points out that its could be applied to market analyses and other more commercial uses," he wrote.

The SHORE app, while shown in a video, is not available in any . "It's not clear if Fraunhofer has built it into a soon-to-be-available app, or if Fraunhofer is waiting to pair the tech with an app partner," said CNET.

This video is not supported by your browser at this time.

What is certain is that the Fraunhofer IIS group is promoting details about its emotion-detection app features for Google Glass. "The new development from Fraunhofer IIS is the first emotion recognition software in the world to function in real-time with Google Glass," said the group. "Fraunhofer researchers also have extensive experience in the development of miniaturized and intelligent cameras and the corresponding algorithms," they added. "This know-how was a major factor in the high-performance development of the SHORE-based Google Glass app."

Explore further: MindRDR lets Google Glass users take photos and post them using only concentration

More information: www.iis.fraunhofer.de/en/ff/bs… sichtsdetektion.html

add to favorites email to friend print save as pdf

Related Stories

Google Internet eyewear heads for Britain

Jun 23, 2014

Google on Monday made Glass available in Britain to early adopters willing to spend 1,000 pounds for a chance to dabble with the Internet-linked eyewear.

Recommended for you

Ericsson profit down 10 pct despite higher sales

10 minutes ago

Wireless equipment maker Ericsson says its third-quarter earnings slumped 10 percent despite higher sales due to increased operating costs and negative effects from currency hedging.

UK wind power share shows record rise

1 hour ago

The United Kingdom wind power production has been enjoying an upward trajectory, and on Tuesday wind power achieved a significant energy production milestone, reported Brooks Hays for UPI. High winds from Hurricane Gonzalo were the force behind wind turbines outproducing nuclear power ...

Glass maker deals to exit Apple, Arizona plant

2 hours ago

Nearly 2,000 furnaces installed in a factory to make synthetic sapphire glass for Apple Inc. will be removed and sold under a deal between the tech giant and the company that had been gearing up to produce huge amounts of ...

Global boom in hydropower expected this decade

5 hours ago

An unprecedented boom in hydropower dam construction is underway, primarily in developing countries and emerging economies. While this is expected to double the global electricity production from hydropower, it could reduce ...

User comments : 6

Adjust slider to filter visible comments by rank

Display comments: newest first

Kinryu
4.7 / 5 (3) Aug 28, 2014
Cool, but creepy. I wonder if it has an algorithm to pick up on "smiling nervously to hide extreme discontent"?
Lex Talonis
3 / 5 (2) Aug 29, 2014
Isn't this pscyho analysis bullshit going far enough all ready....

As one of my friends once said "Just fuck off."

People wearing Google Glasses should be set upon as the social leppers they are and kicked into the gutter where they belong - followed by a lynching of Googles management and tech dept.
hangman04
3.4 / 5 (5) Aug 29, 2014
why would i need an app to tell if the person in front of me is sad or happy ?! unless i am a retard i can figure out myself, and i am pretty sure this software can't pick up micro expression, just a general "hunch"!

so either it does smth we can't, like discovering and interpreting micro expression that we normally miss, or do what software recognition does best: find who the person is and list all relevant information about him.

If they want to interpret some sort of facial recognition: let it do it for pets (dogs, cats, whatever) at least since most of the times we are very bad at understanding their behavioral signs.
Scottingham
3.7 / 5 (3) Aug 29, 2014
It could have potential use with people that have a hard time recognizing the emotions of others...like many on the Autism spectrum.
Modernmystic
not rated yet Aug 29, 2014
It would be interesting if they can tie it into something like this:

http://www.cl.cam...0-25.pdf
Modernmystic
not rated yet Aug 29, 2014
Isn't this pscyho analysis bullshit going far enough all ready....

As one of my friends once said "Just fuck off."


Or, maybe not far enough...