AI-Generated Nude Image of 13-Year-Old Girl Causes Psychological Harm and School Withdrawal in Neuquén

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A 14-year-old student in Neuquén, Argentina, used AI to create a manipulated nude image of a 13-year-old classmate, causing her psychological distress and refusal to return to school. The girl's mother filed a complaint with authorities, seeking psychological support and a transfer to another school.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event explicitly mentions the use of AI to create a fake nude image of a 13-year-old girl, which is a direct violation of her rights and causes psychological harm. The AI system's use here is malicious and has directly led to harm (psychological distress, violation of privacy, potential reputational damage). This fits the definition of an AI Incident because the AI system's use has directly led to harm to a person (a minor) and a violation of rights. The involvement of AI is clear and central to the harm described.[AI generated]
AI principles
Privacy & data governanceRespect of human rights

Industries
Education and training

Affected stakeholders
Children

Harm types
PsychologicalHuman or fundamental rights

AI system task:
Content generation


Articles about this incident or hazard