AI-Generated Fake Nude Images of Students Sold and Used for Extortion in Argentine School

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

At Instituto Murialdo in Villa Bosch, Argentina, students used AI tools to create fake nude images of female classmates, which were then sold, shared, and used for threats and extortion. The incident, ongoing for years, caused psychological harm and sparked protests demanding stronger protective measures.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event explicitly mentions the use of AI to generate nude images of students without their consent, which were then shared and sold, causing harassment and threats. This clearly involves an AI system's use leading directly to harm to individuals (psychological harm, violation of rights) and harm to the school community. The harm is realized and ongoing, not just potential. Hence, it meets the criteria for an AI Incident due to violations of rights and harm to communities caused by the AI-generated content and its malicious use.[AI generated]
AI principles
Respect of human rightsSafety

Industries
Education and training

Affected stakeholders
Children

Harm types
PsychologicalHuman or fundamental rights

AI system task:
Content generation


Articles about this incident or hazard