14-Year-Old Investigated for Creating and Sharing AI-Generated Pornographic Deepfakes of Classmates

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A 14-year-old student in Logroño, Spain, used AI tools to create and disseminate pornographic deepfake images of nine underage classmates, using photos from their social media profiles without consent. The images were widely viewed online, causing significant harm to the victims' privacy and emotional well-being. Legal action is underway.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves the use of AI systems to generate manipulated pornographic images of minors, which were then disseminated, causing direct harm to the victims' privacy, emotional well-being, and rights. This constitutes a violation of human rights and laws protecting minors, fulfilling the criteria for an AI Incident due to the direct harm caused by the AI-generated content and its distribution.[AI generated]
AI principles
Respect of human rightsPrivacy & data governance

Industries
Media, social platforms, and marketing

Affected stakeholders
Children

Harm types
Human or fundamental rightsPsychologicalReputational

Severity
AI incident

AI system task:
Content generation


Articles about this incident or hazard