AI-Generated Deepfakes Spark Digital Violence Debate in Germany

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Actress Collien Fernandes testified in the North Rhine-Westphalia parliament about her experience with AI-generated deepfakes and fake profiles used to spread sexualized, non-consensual content. The incident led to public debate and protests over digital violence, highlighting the harm caused by AI systems in Germany.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves AI systems (deepfake technology) used maliciously to create sexualized content that harms individuals, constituting violations of rights and psychological harm. The harm is realized and ongoing, as evidenced by reports of victims, failed platform responses, and lack of effective legal recourse. This fits the definition of an AI Incident because the AI system's use has directly led to harm. While the article also discusses legal and societal responses, the primary focus is on the harm caused by AI-generated deepfakes, not just the response, so it is not merely complementary information.[AI generated]
AI principles
Respect of human rightsPrivacy & data governance
Industries
Media, social platforms, and marketing
Affected stakeholders
Women
Harm types
PsychologicalReputationalHuman or fundamental rights
AI system task:
Content generation

Articles about this incident or hazard