AI-Generated Deepfake Porn Causes Widespread Harm and Violates Consent

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

AI-powered deepfake technology is being used to create nonconsensual pornographic videos, targeting both celebrities and ordinary individuals. Victims, like college student Taylor Klein, suffer emotional distress, privacy violations, harassment, and threats to safety. The proliferation of cheap deepfake apps has made this abuse widespread, highlighting serious risks to personal rights and consent.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves the use of AI deepfake technology to create nonconsensual pornographic videos, which is a clear violation of privacy and consent rights, thus a breach of fundamental human rights. The harm is realized and ongoing, with documented cases of emotional and reputational damage to victims. The AI system's role is pivotal as it enables the creation of realistic fake videos that would not be possible otherwise. The article also highlights the proliferation and increasing demand for such AI-generated content, confirming the direct link between AI use and harm. Hence, this is classified as an AI Incident.[AI generated]
AI principles
AccountabilityHuman wellbeingPrivacy & data governanceRespect of human rightsSafetyTransparency & explainabilityDemocracy & human autonomy

Industries
Media, social platforms, and marketing

Affected stakeholders
General public

Harm types
PsychologicalReputationalHuman or fundamental rights

Severity
AI incident

AI system task:
Content generation

In other databases


Articles about this incident or hazard

Thumbnail Image

Demand for deepfake pornography is exploding. We aren't ready | Moira Donegan

2023-03-13
The Guardian
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI deepfake technology to create nonconsensual pornographic videos, which is a clear violation of privacy and consent rights, thus a breach of fundamental human rights. The harm is realized and ongoing, with documented cases of emotional and reputational damage to victims. The AI system's role is pivotal as it enables the creation of realistic fake videos that would not be possible otherwise. The article also highlights the proliferation and increasing demand for such AI-generated content, confirming the direct link between AI use and harm. Hence, this is classified as an AI Incident.
Thumbnail Image

The College Student Whose Face Was Deepfaked Onto Porn

2023-03-11
The Daily Beast
Why's our monitor labelling this an incident or hazard?
The event involves the use of an AI system (deepfake technology) to create nonconsensual pornographic content, which directly harms the individuals involved by violating their privacy, causing emotional and psychological harm, and exposing them to harassment and safety risks. This fits the definition of an AI Incident as it involves the use and misuse of an AI system leading to violations of human rights and harm to individuals. The article details actual harm that has occurred, not just potential harm, and thus it is classified as an AI Incident rather than a hazard or complementary information.
Thumbnail Image

A College Girl Found Deepfake Porn of Herself Online. Who Did It Shocked Her.

2023-03-13
Rolling Stone
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems (deepfake technology) to create nonconsensual pornographic content, which directly harms the individuals involved by violating their privacy and causing psychological distress. This constitutes a violation of human rights and personal dignity, fitting the definition of an AI Incident. The harm is realized and ongoing, with victims experiencing harassment and social consequences. The involvement of AI in generating the deepfake content is explicit and central to the harm described.
Thumbnail Image

'Another Body' Review: Intriguing Deepfake Porn Doc Is Not as Deep as You'd Think

2023-03-14
The Hollywood Reporter
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI deepfake technology to create non-consensual pornographic content, which directly leads to violations of personal rights and emotional harm to the victims. The AI system's use in this context has caused realized harm, including doxxing and potential threats to safety, fitting the definition of an AI Incident under violations of human rights and harm to individuals. Therefore, this event qualifies as an AI Incident.
Thumbnail Image

Demand for deepfake pornography is exploding: We are not ready for this assault on consent - Taipei Times

2023-03-15
Taipei Times
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems (deepfake face-swapping technology) to create nonconsensual pornographic videos, which directly causes harm to individuals by violating their rights and consent. The harm is materialized, as evidenced by the emotional distress and public exposure of victims. The AI system's use is central to the harm, fulfilling the criteria for an AI Incident under violations of human rights and harm to communities. The article does not merely discuss potential harm or responses but reports on actual ongoing harm caused by AI misuse.
Thumbnail Image

[SXSW '23] Another Body' review: Frightening look at the effects of deepfake porn * AIPT

2023-03-13
AIPT
Why's our monitor labelling this an incident or hazard?
Deepfake pornography is generated using AI systems that create realistic but fake videos. The article details the direct harm to victims, including harassment, emotional distress, and violation of privacy and rights. The AI system's role in producing these videos is central to the harm described. Therefore, this event qualifies as an AI Incident under the framework, as it involves realized harm caused by AI-generated content violating human rights and causing harm to individuals.