AI-Generated Fake Intimate Images of Minors Investigated in Brazil

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

In Governador Valadares, Brazil, four students used AI tools to create and share fake intimate images of minor classmates. The incident prompted a police investigation and internal school actions, including suspending the involved students and providing support to victims. The AI-generated content caused significant psychological and legal harm.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly states that AI tools were used to generate false intimate images of minors, which were then shared, causing harm to the victims. This use of AI directly led to violations of rights and harm to the individuals involved. The harm is not hypothetical but has occurred, and the AI system's role is pivotal in creating the harmful content. Hence, this event meets the criteria for an AI Incident under violations of human rights and harm to individuals.[AI generated]
AI principles
Privacy & data governanceRespect of human rights

Industries
Education and training

Affected stakeholders
Children

Harm types
PsychologicalHuman or fundamental rights

Severity
AI incident

AI system task:
Content generation


Articles about this incident or hazard