AI-Generated Explicit Images of Students Spark Police Investigation in Jakarta

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A student at a Jakarta Timur junior high school used AI to edit classmates' photos into explicit content, reportedly producing and selling around 200 images. The incident, which caused significant harm to the victims, prompted a police investigation into sexual harassment and misuse of AI technology.[AI generated]

Why's our monitor labelling this an incident or hazard?

The use of AI to create vulgar edited images of students and distribute them causes direct harm to the victims' rights and dignity, fitting the definition of an AI Incident under violations of human rights and harm to communities. The police investigation and the reported physical violence are consequences of this harm. Therefore, this event qualifies as an AI Incident.[AI generated]
AI principles
Respect of human rightsPrivacy & data governance

Industries
Education and training

Affected stakeholders
Children

Harm types
PsychologicalReputationalHuman or fundamental rights

AI system task:
Content generation


Articles about this incident or hazard