AI-Generated Deepfake Porn Causes Harm to German Women

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

In Germany, AI-generated deepfake technology was used to create sexualized fake videos and images of women, including Theresia and Atessa, without their consent. The victims suffered psychological harm, reputational damage, and felt unsupported by authorities, highlighting the dangers of AI misuse for digital violence.[AI generated]

Why's our monitor labelling this an incident or hazard?

Deepfakes are generated using AI systems that create realistic fake images or videos. The creation and distribution of non-consensual deepfake pornography is a clear violation of human rights and causes harm to the victim. The article details the victim's experience of harm and the legal outcome, confirming that harm has materialized. Therefore, this event qualifies as an AI Incident due to direct harm caused by the AI system's use.[AI generated]
AI principles
Privacy & data governanceRespect of human rights

Industries
Media, social platforms, and marketing

Affected stakeholders
Women

Harm types
PsychologicalReputational

AI system task:
Content generation


Articles about this incident or hazard