Normandy Deepfake Pornography Incident Involving Minors

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Authorities in Saint-Hilaire-du-Harcouët, Normandy, have launched an investigation after deepfake pornographic videos featuring twelve schoolgirls from the private Immaculée Conception were distributed. The perpetrators used AI technology to superimpose minors' faces in explicit scenes, violating privacy and human rights.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event explicitly mentions the creation and distribution of deepfake videos, which are AI-generated synthetic content. The harm is realized as the victims are identified and the videos are of sexual nature, causing personal and community harm. The AI system's use in generating these deepfakes is central to the incident, fulfilling the criteria for an AI Incident due to violations of rights and harm to individuals.[AI generated]
AI principles
Privacy & data governanceRespect of human rightsSafetyHuman wellbeingAccountabilityRobustness & digital security

Industries
Education and trainingMedia, social platforms, and marketingDigital security

Affected stakeholders
Children

Harm types
Human or fundamental rightsPsychologicalReputationalPublic interest

Severity
AI incident

AI system task:
Content generationRecognition/object detection


Articles about this incident or hazard