Microsoft grounds foul-mouthed teen-speak bot

March 24, 2016
Tay is a machine learning project—one in which software can evolve as it is being used—designed for human engagement
Tay is a machine learning project—one in which software can evolve as it is being used—designed for human engagement

A Microsoft "chatbot" designed to converse like a teenage girl was grounded on Thursday after its artificial intelligence software was coaxed into firing off hateful, racist comments online.

Microsoft this week launched the experiment in which the bot nicknamed "Tay" was given the personality of a teenager and designed to learn from online exchanges with real people.

Bu the plan was sent awry by an ill-willed campaign to teach her bad things, according to the US software colossus.

"It is as much a social and cultural experiment, as it is technical," a Microsoft spokesperson said Thursday in response to an AFP inquiry.

"Unfortunately, within the first 24 hours of coming online, we became aware of a coordinated effort by some users to abuse Tay's commenting skills to have Tay respond in inappropriate ways."

Tay is a machine learning project—one in which software can evolve as it is being used—designed for human engagement. But it got a harsh lesson in what it can learn from people.

As a result, Tay was taken offline for adjustments to the software, according to Microsoft.

"C U soon humans need sleep now so many conversations today," Tay said in its final post on Twitter.

All the offensive Twitter posts by Tay were removed, but many echoed online in the form of captured screen shots.

Tay tweets ranged from support for Nazis and Donald Trump to sexual comments and insults aimed at women and blacks.

Tay's profile at Twitter describes it as AI (artificial intelligence) "that's got zero chill" and gets smarter as people talk to it.

People could chat with Tay at Twitter and other messaging platforms, and even send the software digital photos for comment.

The project was said to target young adults with chatter styled after a teenage girl.

Explore further: 'Golden Tweet' is Twitter's most echoed note in 2013

Related Stories

Recommended for you

Apple issues update after cyber weapon captured

August 26, 2016

Apple iPhone owners on Friday were urged to install a quickly released security update after a sophisticated attack on an Emirati dissident exposed vulnerabilities targeted by cyber arms dealers.

37 comments

Adjust slider to filter visible comments by rank

Display comments: newest first

daqman
5 / 5 (5) Mar 24, 2016
This is the best thing I've read all week. Hand's down. It restores my faith in human nature to take and AI and drag it through the muck!
srikkanth_kn
3 / 5 (2) Mar 24, 2016
This is AI hacking.
Lex Talonis
2.3 / 5 (6) Mar 25, 2016
If it's not talking about anal sex, the bitch next door, how much the boy friend likes to cum on her face, and eating junk food and watching porn - then it's not a teen age girl.
tblakely1357
5 / 5 (3) Mar 25, 2016
Crappy parenting is the cause. :P
RichManJoe
3.7 / 5 (3) Mar 25, 2016
This should be considered a learning experience. Just think if we had given it access to guns, or better yet, the big first strike launch button.
compose
Mar 25, 2016
This comment has been removed by a moderator.
freeiam
2.7 / 5 (3) Mar 25, 2016
Nice indication how to judge other 'succefull' AI projects, like self driving cars.
It's clear we can trust the companies that say it's ok ...
rrrander
3 / 5 (6) Mar 27, 2016
In modern technology companies, unless everyone and everything tows the "progressive" line, it's forbidden.
Da Schneib
4 / 5 (4) Mar 27, 2016
An artificial intelligence exposed to the Internet turns into a monster.

Just sayin'.
antigoracle
5 / 5 (2) Mar 28, 2016
And, in other news, Microsoft cancels autonomous car project that drives like a teenage girl.
Phys1
5 / 5 (1) Mar 28, 2016
I have two teen age daughters that are very smart and know what they are doing and what they are talking about. I doubt that "A Microsoft "chatbot" designed to converse like a teenage girl" could talk like them. This is another nasty stereotype.
Soon they will learn how to drive and I am sure they will be better than a lot of my fellow male drivers.
krundoloss
5 / 5 (2) Mar 28, 2016
They would probably have better luck by not endorsing thier AI projects, anyone that hears about an M$ AI they can converse with, they just want to break it. Since it is setup by M$ then they are accountable, and the whole project is subjected to scrutiny. They should remove thier association with the thing so they can work out the kinks without worry of a "PR Nightmare". Its not like the AI has political or racial preferences, it is just running code, LOL.
antigoracle
1.8 / 5 (5) Mar 28, 2016
I have two teen age daughters that are very smart and know what they are doing and what they are talking about.

Good to see that they took after their mom. Did she tell you who their daddy is?
gkam
1 / 5 (4) Mar 28, 2016
Was the name of the bot otto or Ira or Trumpy??
Uncle Ira
3.4 / 5 (7) Mar 28, 2016
Was the name of the bot otto or Ira or Trumpy??

Skippy, you keep telling the lies and libels on me I am going to get some lawyers and the high sheriff and then you will be sorry. You can't postum libels like that and think you can get away with it no matter how "real" you are.

I never use the bad language ever. And I don't say nasty mean things either. I just make the jokes and fool around. If you don't want to be in my jokes, maybe you should try not to stand out so much.

ogg_ogg
5 / 5 (1) Mar 28, 2016
Reminds me of the do-gooder NGO who traded gmo sheep for (very poor/peasant) farmer's stock. They expected that the sheep would be healthier, live longer, give more wool, and be more valuable at market and hence raise the incomes of these indigenous people. What happened was that the local "aristocratic" farmers/landowners stole those sheep, while the cops stood by and winked, and the poor were left with nothing. Do-gooders who don't anticipate ALL aspects of human nature (for instance corruption, greed, envy, laziness, and abuse of power) are simply idiots. Something about people who don't learn from history are fated to repeat it. Obviously, the MS app wasn't tested for interacting with teenage boys, let alone all the (adult) pervs and trolls out here. Morons.
TheGhostofOtto1923
4 / 5 (4) Mar 28, 2016
Ahaahaaaaa support for Donald trump equated with nazis. So subtle - did you miss it?

What heinous subliminal spinbots are writing these articles? Arent they worse than robot pottymouths?

All Hail the next president of the USA.

Und Morgan die ganze Welt.
gkam
1 / 5 (4) Mar 28, 2016
Why do we still have Nazis?
Uncle Ira
3.7 / 5 (6) Mar 28, 2016
Why do we still have Nazis?

Why we still have robbers? Why we still have murders? Why we still have rapists? Why we still have terrorists? Why we still have wife beaters? Why we still have child molesters? Why we still have preachers?

The human is the very complicated thing Cher, and if you get a lot of complicated things all mixed in to great big complicated groups of things interacting then things get to going wrong. And the more and more complicated things you got, the more chance you got of something getting out of whack,,,, sometimes in a little way, sometimes in a big way.

So Cher, that is why we still have NAZIs.
gkam
1 / 5 (4) Mar 28, 2016
No, it is because we still have folk with little character.
Uncle Ira
3.4 / 5 (5) Mar 28, 2016
Why do we still have Nazis?


The human is the very complicated thing Cher, and if you get a lot of complicated things all mixed in to great big complicated groups of things interacting then things get to going wrong. And the more and more complicated things you got, the more chance you got of something getting out of whack,,,, sometimes in a little way, sometimes in a big way.

No, it is because we still have folk with little character.

Well if it as simple as that, why you haven't won the Nobel Peace Prize?

Cher, I got to know. Are you one of those "medical" potheads? Maybe that is why you think your slogans are great profound insights. They are not, they are just plain goofy.
gkam
1 / 5 (4) Mar 28, 2016
"I never use the bad language ever. And I don't say nasty mean things either. "
------------------------------------

What's a couyon?

What does"dumb as a stump(y)" mean?
Captain Stumpy
4 / 5 (4) Mar 28, 2016
No, it is because we still have folk with little character.
@liar-kam
bad character isn't just your personal belief that people are bad
it comes from a lot of things, including things like this:
the pathological need for attention
seeking to be in control of others
blatant misinformation
miscommunication for the sake of personal aggrandizement (like bragging)
self-hate (especially when others produced lifestyles you wish to have - like being a real soldier/FF)
loathing/hatred of others who don't conform to your personal wishes
brittle ego
and chronic lying

- these are all traits you routinely present to others on PO alone
all verifiable

therefore, by your very own definition, you are a bad character and the reason there are Nazi's, murderers, etc

Uncle Ira
3.4 / 5 (5) Mar 28, 2016
What's a couyon?
It's a foolish man. What, I should lie and call you a deep profound witty glib sharp intellect? It's not bad language, it's not mean or nasty. It's just an observation based on what you show us here.

What does"dumb as a stump(y)" mean?
I don't know, that is not any of my stuffs. But if I call you "dumb as a cypress stump" like I do sometimes, it is not bad language. And it is not mean or nasty. It is a very common saying. It means: "You are really stupid". What, you still want me to lie some more and tell you that you are erudite, well informed, widely read and a rational logical genius? It's a "real" discription of how you "real"ly look here.

If you think that is mean and nasty Cher, you must have lived a charmed and sheltered life. But the main thing that shows us that and proves you are the couyon, is this thing you whine about all time, is the very thing YOU started first, you ignorant, uneducated, goober.
gkam
1 / 5 (4) Mar 28, 2016
"you must have lived a charmed and sheltered life"
-------------------------------------

Right. You saw much of my history. Try to match it.

And I was not the pseudo-cajun taking shots at others in "jest" to make himself look clever. And when you challenged me in all my various jobs, it drove you and your Cypress buddy nuts to see it all proven, despite your claims and protestations.

You found a real person, not afraid to take you on.
Uncle Ira
3.7 / 5 (6) Mar 28, 2016
You found a real person, not afraid to take you on.
And I thank your for that Cher. I have enjoyed it a lot me. That might your greatest redeeming quality, you are the great big fun. Watching you win and make me mad has been one of those simple little pleasures that sometimes comes our way in life.
Uncle Ira
3.4 / 5 (5) Mar 28, 2016
You saw much of my history.
Yeah, so? What I saw is not much to marvel at. It's the history I haven't seen that is so much fun.

Try to match it
Cher, I have told several times before. I don't want to be like you. You seem like you are grumpy and unhappy all the time. I want to be like me, nothing very special outside of my family and little tribe. Life is good for me, and good to me too.

You seem to have some weird idea that everybody else is obsessed with the same things you are. And that is how you show your hand you want "those things" too much. It means too much to you that we see you have all "those things" that make you special. "Those things" whether you have them or not, are not important to anybody but you.

And thinking we are going to be impressed with "those things" like you want us to, is one of the truest signs of your mental conditions regrets you are having in your elderly years.
antigoracle
3 / 5 (2) Mar 28, 2016
You found a real person

Sounds like the coping mechanism, your mental health professional told you to keep reciting, since everything about you is a lie.

not afraid to take you on.

Spoken like a true psychopath.
gkam
1 / 5 (4) Mar 28, 2016
"You seem to have some weird idea that everybody else is obsessed with the same things you are"
---------------------------------------

I am wondering why you are obsessed with me.

It is your problem, Toots. Live with it.
Uncle Ira
3.7 / 5 (3) Mar 28, 2016
"You seem to have some weird idea that everybody else is obsessed with the same things you are"
---------------------------------------

I am wondering why you are obsessed with me.
Obsessed? Okayeei, it you want to call it that. You are great big fun Cher. Non more than that and non less than that. I happen to be interested in watching peoples do what they do, expecially when they are putting on airs and want to try to make the world see them selfs like they want to be seen.

I am not mad Cher, I am amused. I am not SCARED Cher, I am entertained. I don't wish to be what you are Cher, then I would be the one here looking foolish and silly like you. Cher, this is not a church, a classroom or gentleman's club. It is the comments section on the physorg, it attracts a lot of couyons for me to have fun with. It attracts goobers for you talk down to and chastise.

It also attracts a lot of people who know a whole lot more that you, and that is what makes you fun.
Captain Stumpy
3.7 / 5 (3) Mar 28, 2016
I am wondering why you are obsessed with me.

It is your problem, Toots. Live with it.

No one is obsessed with you, per se... but rather with your professional "victim-hood" and your intentional blatant lies about science and engineering

when you can't actually validate a claim with evidence, you immediately state you are a real person, you proved this, you were a commandosuperseniorengineer with uber secret nuke knowledge...

problem is, you can't actually make that claim when you can't comprehend that your own fearmongering tactics are blatantly false because the evidence directly refutes your own claims - the evidence from not only your own org, but from *all* world organizations!
(you know, those irritable safety stats you keep ignoring)

people need to know you are a professional victim lying about science

Thunderf00t said it best
https://www.youtu...EwjBXlZE
viko_mx
1 / 5 (1) Mar 28, 2016
The artificial intelect (AI) is just another myth. This bot is usual program that perform algorithms that are product of human intelligence. There is no feelings, thoughts, imagination and creativity. The objective of this myth is to suggest that evolution is possible without intelligent intervention. But it is not because there is no source of information which is product of consciousness, ideas and goals according to the moral principles of inteligent being.
TheGhostofOtto1923
4 / 5 (4) Mar 29, 2016
Why do we still have Nazis?
Why do we still have psychopaths?
it is because we still have folk with little character
Psychopaths will pretend to have character if it helps them to get what they want.

"...they can imitate feelings, but the only real feelings they seem to have - the thing that drives them and causes them to act out different dramas for effect - is a sort of "predatorial hunger" for what they want. That is to say, they "feel" need/want as love, and not having their needs/wants met is described as "not being loved" by them. What is more, this "need/want" perspective posits that only the "hunger" of the psychopath is valid, and anything and everything "out there," outside of the psychopath, is not real except insofar as it has the capability of being assimilated to the psychopath as a sort of "food." "Can it be used or can it provide something?" is the only issue about which the psychopath seems to be concerned."

-Hungry for the good life baby.
TheGhostofOtto1923
4 / 5 (4) Mar 29, 2016
Another thread off to a promising start until it was hijacked yet again by George kamburoff the self-centered, lying, cheating psychopath.

Pissing people off is the only way you know you're still alive isn't it georgie? If not for that no one would notice your bullshit at all.

Little guys have to talk loud.
Lex Talonis
not rated yet Mar 30, 2016
I don't have the time to do it... but chatting with "robot phone systems" and "text predictive chat programs" - where the systems simply read what you have said or typed and then on the basis of words, word grouping and word sequences, predict the most likely "right answer / response"....

So given Microsofts talent for churning out products that are not even ready for consumer testing, but they do it anyway, because it's cheaper than actually testing it at all, prior to selling it...

It must have been good fun to have run rings around M$'s idiot software, and to get it to elicit all sorts of replies...

Bragging rights double plus. :)

antialias_physorg
5 / 5 (2) Mar 30, 2016
It restores my faith in human nature to take and AI and drag it through the muck!

You are aware that the same result would be arrived at if a human child were brought up being exposed to the same kind of input that this AI was?

This 'failure' is not AI specific. "Give me a child before the age of seven.." and all that.
Machine learning emulates the human learning process. Teach it racism, sexism or whetever and it will turn into a racist, sexist, etc. AI.

I think a lot of people here are confused about what an AI (such as Tay) actually is. Such an AI is a prgramm that can learn (i.e. adapt to changing input). It does not judge the input.
Judging requires being aware of the meaning of words (i.e. by comparing to a value context and/or connection to real experience). Such a context/experience is not part of these types of AI programs (yet).
TheGhostofOtto1923
5 / 5 (3) Mar 30, 2016
Right. You saw much of my history. Try to match it
Hmmm george kamburoff is the guy who thinks he is an engineer, or actually better than an engineer, because he had a few job shop positions with the term engineer in the title. And also taught lunch-and-learns.

George kamburoff is the guy who thinks that a junior birdman of the month award makes him an expert in aeronautics, surveillance, government, and etc.

George kamburoff is the guy who is so desperate to establish credibility that he gets an honorary 'life experience' MS and then thinks he can LIE about it being for environmental mgt, and get away with it.

George kamburoff claims that standing in a nuke reactor control room, and also doing validation on one subsystem offsite as a temp, makes him an authority on reactor engg and waste storage.

No george, I for one think I could invent a much better personal history than you did.

You lying fucking imbecile.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.