Spanish Teen Arrested for Creating and Distributing AI-Generated Child Abuse Images

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A 17-year-old in Súria, Spain, was arrested for using AI to generate and distribute pornographic images of minors. He sourced photos from social media and his own camera, manipulated them with AI to remove clothing, and shared the illegal content online, constituting serious harm and legal violations.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves the use of an AI system (intelligence artificial) to manipulate images of minors to create illegal sexual content. This use of AI directly led to harm, specifically violations of human rights and legal protections concerning child exploitation and pornography. The AI system's use in modifying images is central to the harm caused, making this an AI Incident.[AI generated]
AI principles
Respect of human rightsSafetyAccountability
Industries
Media, social platforms, and marketing
Affected stakeholders
Children
Harm types
Human or fundamental rightsPsychological
AI system task:
Content generation

Articles about this incident or hazard