AI-Generated Fake Nude Images of Minors Circulated in Alcalá de Henares

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

In Alcalá de Henares, AI was used to manipulate images of minors to create fake nude photos, which were then shared on social media. Police identified the perpetrator, a minor, and referred the case to the courts. The incident caused significant harm to the victims and their families.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event explicitly mentions the use of an AI program to create manipulated nude images of minors, which were then spread on social media, causing harm to the victims and their families. This is a clear violation of rights and a form of harm to communities. The AI system's use directly led to this harm, fulfilling the criteria for an AI Incident.[AI generated]
AI principles
Privacy & data governanceRespect of human rightsSafetyAccountabilityRobustness & digital securityTransparency & explainabilityHuman wellbeing

Industries
Media, social platforms, and marketingGovernment, security, and defenceDigital security

Affected stakeholders
ChildrenGeneral public

Harm types
Human or fundamental rightsPsychologicalReputational

AI system task:
Content generation


Articles about this incident or hazard