AI-driven harassment forces Jenna Ortega off Twitter

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Jenna Ortega, known for her role in Netflix's "Wednesday," was forced to leave Twitter due to AI-facilitated harassment. The actress, who gained significant fame, became a target for online haters using AI technology to enhance their attacks, highlighting privacy and harassment issues linked to AI misuse.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article describes the malicious use of AI deepfake technology to create non-consensual, pornographic images of the underage actress. This misuse directly harmed her reputation and emotional well-being and forced her off the platform. The AI system’s misuse has led to realized harm, constituting an AI incident.[AI generated]
AI principles
Privacy & data governanceRespect of human rightsSafetyAccountabilityRobustness & digital securityTransparency & explainabilityDemocracy & human autonomy
Industries
Media, social platforms, and marketingDigital security
Affected stakeholders
Women
Harm types
Human or fundamental rightsPsychologicalReputational
Severity
AI incident
AI system task:
Content generationInteraction support/chatbots

Articles about this incident or hazard

Thumbnail Image

Jenna Ortega costretta a lasciare Twitter per colpa della AI: cosa è successo

2024-08-26
il Giornale.it
Why's our monitor labelling this an incident or hazard?
The article describes the malicious use of AI deepfake technology to create non-consensual, pornographic images of the underage actress. This misuse directly harmed her reputation and emotional well-being and forced her off the platform. The AI system’s misuse has led to realized harm, constituting an AI incident.
Thumbnail Image

Jenna Ortega cancella i social e attacca l'intelligenza artificiale: "Contenuti sporchi e modificati"

2024-08-26
Il Mattino
Why's our monitor labelling this an incident or hazard?
The event explicitly involves AI-generated deepfake content that depicts the actress in a harmful and illegal manner (explicit images of a minor), which constitutes a violation of rights and causes personal harm. The AI system's use in generating these images is directly linked to the harm experienced by Jenna Ortega, fulfilling the criteria for an AI Incident under violations of human rights and harm to individuals.
Thumbnail Image

Jenna Ortega è stata bersagliata di foto pedopornografiche generate dall'AI

2024-08-26
Wired
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI-generated pedopornographic images (deepfakes) targeting Jenna Ortega, which caused her distress and led to her leaving the social media platform. The AI system was used maliciously to create harmful content, directly resulting in harm to the actress's mental health and personal rights. This fits the definition of an AI Incident as the AI system's use directly led to harm to a person and a violation of rights.
Thumbnail Image

"È disgustoso": Jenna Ortega via da Twitter per colpa di una foto raccapricciante

2024-08-25
Best Movie
Why's our monitor labelling this an incident or hazard?
An AI system was used to generate manipulated pornographic images of a minor without consent, which directly harms the individual's dignity, privacy, and rights. The AI-generated content caused psychological harm and distress to Jenna Ortega, who was a minor at the time. This fits the definition of an AI Incident as it involves harm to a person and violation of rights due to the use of AI in creating harmful content.
Thumbnail Image

Jenna Ortega condanna l'IA e abbandona i social: "Sono disgustata"

2024-08-26
Voci di Città
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI-generated deepfake images that have caused harm to Jenna Ortega by depicting her in explicit poses as a minor, which is a serious violation of privacy and personal rights. The AI system's use in generating these images is central to the harm. This constitutes a violation of fundamental rights and a breach of privacy, fitting the definition of an AI Incident. The event is not merely a potential risk or a complementary update but a realized harm caused by AI misuse.