Tay: A Cautionary Tale of AI

chatbot and postsTay was a chatbot originally released by Microsoft Corporation as a Twitter bot on March 23, 2016. It "has had a great influence on how Microsoft is approaching AI," according to Satya Nadella, the CEO of Microsoft.

Tay caused almost immediate controversy when the bot began to post inflammatory and offensive tweets through its Twitter account, causing Microsoft to shut down the service only 16 hours after its launch. According to Microsoft, this was caused by trolls who "attacked" the service as the bot made replies based on its interactions with people on Twitter - a dangerous proposition.

It was named "Tay" as an acronym for "thinking about you." It was said that it was similar to or based on Xiaoice, a similar Microsoft project in China that Ars Technica reported that it had "more than 40 million conversations apparently without major incident".

Interestingly, Tay was designed to mimic the language patterns of a 19-year-old American girl and presented as "The AI with zero chill."

It was quickly abused with Twitter users began tweeting politically incorrect phrases, teaching it inflammatory messages so that the bot began releasing racist and sexually-charged messages in response to other Twitter users.

One artificial intelligence researcher, Roman Yampolskiy, commented that Tay's misbehavior was understandable because it mimicked the deliberately offensive behavior of other Twitter users, and Microsoft had not given the bot an understanding of inappropriate behavior. He compared the issue to IBM's Watson, which began to use profanity after reading entries from the website Urban Dictionary.

It was popular in its short life. Within 16 hours of its release, Tay had tweeted more than 96,000 times, That is when Microsoft suspended the account for "adjustments." Microsoft confirmed that Tay had been taken offline, released an apology on its official blog, and said it would "look to bring Tay back only when we are confident we can better anticipate malicious intent that conflicts with our principles and values."

Then on March 30, 2016, Microsoft accidentally re-released the bot on Twitter while testing it. Given its freedom, Tay released some drug-related tweets, then it became stuck in a repetitive loop of tweeting "You are too fast, please take a rest", several times a second. The posts appeared in the feeds of 200,000+ Twitter followers.

Tay has become a cautionary tale on the responsibilities of creators for their AI.

In December 2016, Microsoft released Tay's successor, a chatbot named Zo which was an English version of Microsoft's other successful chatbots Xiaoice (China) and Rinna [ja] (Japan).

Terms of Service

those confusing terms of serviceTerms of service. That information you tend to avoid reading. Good example: Google's newly updated terms of service, which I found out about in an email last week. I decided to read them.

Their updated terms opens with "We know it’s tempting to skip these Terms of Service, but it’s important to establish what you can expect from us as you use Google services, and what we expect from you. These Terms of Service reflect the way Google’s business works, the laws that apply to our company, and certain things we’ve always believed to be true. As a result, these Terms of Service help define Google’s relationship with you as you interact with our services."

Here are a few items I noted:
Some things considered to be abuse on the part of users includes accessing or using Google services or content in fraudulent or deceptive ways, such as:
phishing
creating fake accounts or content, including fake reviews
misleading others into thinking that generative AI content was created by a human
providing services that appear to originate from you (or someone else) when they actually originate from us
providing services that appear to originate from us when they do not
using our services (including the content they provide) to violate anyone’s legal rights, such as intellectual property or privacy rights
reverse engineering our services or underlying technology, such as our machine learning models, to extract trade secrets or other proprietary information, except as allowed by applicable law
using automated means to access content from any of our services in violation of the machine-readable instructions on our web pages (for example, robots.txt files that disallow crawling, training, or other activities)
hiding or misrepresenting who you are in order to violate these terms
providing services that encourage others to violate these terms

Take that second item I highlighted about misleading others into thinking that generative AI content was created by a human, Does that mean that if I use their generative AI or some other provider's AI to help write a blog post that I put here with my name that I am violating their terms of service?

Though I would say that Google's Terms of Service is written in plain langauage that most readers should be able to understand, the implications of some of the terms are much harder to interpret.

NOTE: The Google Terms of Service (United States version) that I reference are effective May 22, 2024.
View
Archived versions and  Download a PDF

 

 

AI and Bias

Bias has always existed. It has always existed online. Now, with AI, there is another level of bias.

Bias generated by technology is “more than a glitch,” says one expert.

For example, why does AI have a bias against dark skin? It is because its data is scraped from the Internet, and the Internet is full of biased content.

This doesn't give AI a pass on bias. It is more of a comment or reflection on bias in general.

Harmful Content Online

girl on phone

Photo by Andrea Piacquadio

It is an important issue to cover but, unfortunately, I am not surprised to see a report covered with a BBC headline "More girls than boys exposed to harmful content online."

Teenage girls are more likely to be asked for nude photos online or be sent pornography or content promoting self-harm than boys, a report has found. The report is based on survey responses from around 6,500 young people, and they found that girls are "much more likely to experience something nasty or unpleasant online."

YouTube, WhatsApp, Snapchat, and TikTok were the most popular social media sites for both age groups, but more than three-quarters of 14-18-year-olds also used Instagram.

Many respondents reported spending significant amounts of time online. For instance, a third of 14-18-year-olds reported spending four hours or more online during a school day.  Almost two-thirds reported spending more than four hours online at weekends. One in five 14-18-year-olds said they spent more than seven hours a day online on weekends.

One example is that one in five children and young people who took part in the research said something nasty or unpleasant had recently happened to them online. The most common experience was that "mean or nasty comments" were made about them or sent to them. But there was a difference between boys and girls when it came to the type of nasty online experience they had. Girls were more likely to have mean or nasty comments made about them or rumors spread about them.

More than 5% of girls aged 14-18 said they had been asked to send nude photos or videos online or expose themselves, three times higher than the rate among boys. More than 5% of 14-18 year-old girls also said they had seen or been sent pornography, and twice as many girls as boys reported being sent "inappropriate photos" they had not asked for. More girls than boys also reported being sent content promoting suicide, eating disorders and self-harm.