AI-Generated Sexual Deepfakes of Students Spark Violent Protests at Chilean School

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

At Colegio Alicante del Sol in Puente Alto, Chile, students used AI tools to create and distribute non-consensual sexual deepfake images of female classmates. The incident led to protests, property damage, and police intervention after the accused students returned to school, highlighting the severe harm caused by AI misuse.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event explicitly involves the use of AI to create deepfake images, which are pornographic and non-consensual, causing harm to the victims' rights and dignity. The harm is realized, as evidenced by the protests, social unrest, and intervention by authorities to prevent violence. The AI system's use is central to the harm, as it enabled the creation of the harmful content. Therefore, this qualifies as an AI Incident due to direct harm caused by the AI system's use.[AI generated]
AI principles
Privacy & data governanceRespect of human rights

Industries
Education and training

Affected stakeholders
ChildrenWomen

Harm types
PsychologicalReputationalHuman or fundamental rights

AI system task:
Content generation


Articles about this incident or hazard