AI-Generated Fake Nude Images of Student Shared by Minors in São Paulo

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

In Jaú, São Paulo, eight 15-year-old students used AI tools to create and share fake intimate images of a female classmate via WhatsApp. The incident was discovered by the school, which suspended the students. A parent reported his own son to the police, prompting a criminal investigation.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event explicitly mentions that the images were generated by AI and shared maliciously, causing harm to the victim and leading to legal action. The AI system's use is central to the harm, as it created false intimate images that violated the victim's rights and caused distress. This fits the definition of an AI Incident due to violation of rights and harm to communities. There is no indication that the AI was used beneficially or that this is a potential hazard without realized harm. It is not merely complementary information or unrelated news.[AI generated]
AI principles
Respect of human rightsPrivacy & data governance

Industries
Education and training

Affected stakeholders
Children

Harm types
PsychologicalReputationalHuman or fundamental rights

AI system task:
Content generation


Articles about this incident or hazard