Google rolls out AI tool to combat online trolls

February 24, 2017
Google has developed a programming tool called Perspective to help editors trying to moderate discussions by filtering out abusive 'troll' comments

Google said it will begin offering media groups an artificial intelligence tool designed to stamp out incendiary comments on their websites.

The programming tool, called Perspective, aims to assist editors trying to moderate discussions by filtering out abusive "troll" comments, which Google says can stymie smart online discussions.

"Seventy-two percent of American internet users have witnessed harassment online and nearly half have personally experienced it," said Jared Cohen, president of Google's Jigsaw technology incubator.

"Almost a third self-censor what they post online for fear of retribution," he added in a blog post on Thursday titled "When computers learn to swear".

Perspective is an (API), or set of methods for facilitating communication between systems and devices, that uses machine learning to rate how comments might be regarded by other users.

The system, which will be provided free to media groups including social media sites, is being tested by The Economist, The Guardian, The New York Times and Wikipedia.

Many news organisations have closed down their comments sections for lack of sufficient human resources to monitor the postings for abusive content.

"We hope we can help improve conversations online," Cohen said.

Google has been testing the tool since September with The New York Times, which wanted to find a way to maintain a "civil and thoughtful" atmosphere in reader comment sections.

Perspective's initial task is to spot toxic language in English, but Cohen said the goal was to build tools for other languages, and which could identify when are "unsubstantial or off-topic".

Twitter said earlier this month that it too would start rooting out hateful messages, which are often anonymous, by identifying the authors and prohibiting them from opening new accounts, or hiding them from internet searches.

Last year, Google, Twitter, Facebook and Microsoft signed a "code of good conduct" with the European Commission, pledging to examine most abusive content signalled by users within 24 hours.

Explore further: Instagram lets users filter offensive comments

More information: jigsaw.google.com/projects/#perspective

Related Stories

Instagram lets users filter offensive comments

September 12, 2016

Instagram on Monday began letting users tackle online abuse by creating lists of words that would have comments hidden from sight at the popular photo and video-sharing service.

YouTube revamps much-criticized comments feed

September 24, 2013

YouTube, the Google-owned video sharing website, said Tuesday it was revamping its comments feed which some web users claimed had turned into a magnet for crude and vulgar postings.

Recommended for you

First proof of quantum computer advantage

October 18, 2018

For many years, quantum computers were not much more than an idea. Today, companies, governments and intelligence agencies are investing in the development of quantum technology. Robert König, professor for the theory of ...

Permanent, wireless self-charging system using NIR band

October 8, 2018

As wearable devices are emerging, there are numerous studies on wireless charging systems. Here, a KAIST research team has developed a permanent, wireless self-charging platform for low-power wearable electronics by converting ...

Facebook launches AI video-calling device 'Portal'

October 8, 2018

Facebook on Monday launched a range of AI-powered video-calling devices, a strategic revolution for the social network giant which is aiming for a slice of the smart speaker market that is currently dominated by Amazon and ...

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.