Facebook turns to machine learning

Dec 13, 2013 by Neil Lawrence, The Conversation
Do you know anything about machine learning? Credit: newyork

"Move fast and break things." That is the Facebook motto plastered all over their California headquarters to remind engineers never to stop innovating. This week, the company moved fast and broke some news by investing in a thing called machine learning. They appointed two professors, Yann LeCun and Rob Fergus, from New York University, to lead new artificial intelligence labs in New York, California and London.

Breakthroughs in artificial intelligence (AI) are rare, but last year a team led by Geoff Hinton at the University of Toronto made a significant step forward in understanding the content of images. Geoff and his team set up a company, DNNresearch, to exploit the advance, and were quickly purchased by Google. The technology has already been used to advance image search in Google+. Users can now search their photos for bicycles, dogs, beaches and sunsets as well as thousands of other categories.

The technology they used is known as "deep learning". So the Facebook announcement was Mark Zuckerberg's response to Google's move. By involving leading academics he wants to make sure the job is done right. He attended the conference, hosting a small reception for some of the leading researchers the night before the public announcement. He spent the rest of his time recruiting researchers for the new AI labs.

The reason for the California lab is clear, but why New York and London? The labs are deliberately spread across the world to make it as easy as possible for the leading researchers to move: LeCun and Fergus's new office is only a couple of blocks away from their current location in downtown Manhattan. Details of the London lab are still unclear.

Machine learning is not a new technology at Facebook: they use it to place adverts, rank news feed items and suggest friends for their users. In July 2012 Facebook flew in researchers from around the world to their Menlo Park headquarters for their first "Academic Summit". But this new initiative has a different feel to it. It is not common for the CEO of one of the world's largest companies to turn up at a 2,000-person conference on a large-scale recruitment drive. Facebook is targeting full-scale , something that could compete with a human, and its bet is that deep learning is the right way to arrive at that goal.

Deep thinking

Deep learning technologies are inspired by the layout of neurons in the brain. The signals transmitted by our retina to a region in the brain called the visual cortex are processed by a set of layers of neurons before being interpreted. The first layers of neurons start by detecting simple features in the images, such as the edges of objects. Each layer, in turn, composes more of these features together until the parts of the object are formed. Finally, in the upper layers, a complete understanding of the visual scene can be composed and recognised by our brains.

Hinton and LeCun both began working on computer models more than 25 years ago, inspired by the brain's "deep" architecture. What enables these models to be learned now is the wide availability of data for these models to learn from. This phenomenon, known as big data, is changing the way all businesses are run. Targeted advertising from supermarkets, movie recommendations from Netflix and book suggestions from Amazon are all driven by machine learning models which predict human behaviour.

These luminaries have been attending the NIPS conference for more than 25 years, and this latest breakthrough is just one of a number of technologies that has emerged across this time. Industry has taken note. As well as Facebook and Google the other leading US internet firms: Amazon, Yahoo and Microsoft were also present. News has also spread overseas, the Russian market leader Yandex and the dominant Chinese search provider, Baidu, also attended.

LeCun is on record as stating that the next big challenge for these models is understanding language. This would improve speech recognition and allow search engines to understand the sentiment of a sentence, rather than just counting the statistics of which words are present. Maybe then Facebook could understand your sarcastic status update.

Explore further: Facebook joins NYU in artificial intelligence lab (Update)

add to favorites email to friend print save as pdf

Related Stories

Oh great, Facebook wants to know you're being sarcastic

Sep 26, 2013

You might think social networks couldn't possibly gather more information on you than they already do. That in a world where your every move is tagged, flagged and logged, there is nothing more that could ...

Google buys machine learning startup

Mar 13, 2013

Google said Wednesday that it has bought a Canadian startup specializing in getting machines to understand what people are trying to say.

Recommended for you

Study: Social media users shy away from opinions

17 hours ago

People on Facebook and Twitter say they are less likely to share their opinions on hot-button issues, even when they are offline, according to a surprising new survey by the Pew Research Center.

US warns shops to watch for customer data hacking

Aug 23, 2014

The US Department of Homeland Security on Friday warned businesses to watch for hackers targeting customer data with malicious computer code like that used against retail giant Target.

Fitbit to Schumer: We don't sell personal data

Aug 22, 2014

The maker of a popular line of wearable fitness-tracking devices says it has never sold personal data to advertisers, contrary to concerns raised by U.S. Sen. Charles Schumer.

Should you be worried about paid editors on Wikipedia?

Aug 22, 2014

Whether you trust it or ignore it, Wikipedia is one of the most popular websites in the world and accessed by millions of people every day. So would you trust it any more (or even less) if you knew people ...

How much do we really know about privacy on Facebook?

Aug 22, 2014

The recent furore about the Facebook Messenger app has unearthed an interesting question: how far are we willing to allow our privacy to be pushed for our social connections? In the case of the Facebook ...

Philippines makes arrests in online extortion ring

Aug 22, 2014

Philippine police have arrested eight suspected members of an online syndicate accused of blackmailing more than 1,000 Hong Kong and Singapore residents after luring them into exposing themselves in front of webcam, an official ...

User comments : 0