Students Use AI to Create and Sell Fake Nude Images of Classmates in Argentina

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

At Colegio Modelo Lomas in Lomas de Zamora, Argentina, several students used AI tools to generate fake nude images of at least 40 female classmates, which were then distributed and allegedly sold online, including on adult sites. The incident led to legal action, protests, and community outrage over privacy violations and harm to minors.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article describes the creation and dissemination of sexual images of minors generated with AI, which constitutes a violation of human rights and harm to the affected individuals and community. The AI system was used in the generation of harmful content, and this use directly led to realized harm. Therefore, this event qualifies as an AI Incident under the OECD framework.[AI generated]
AI principles
Privacy & data governanceRespect of human rights

Industries
Education and training

Affected stakeholders
Children

Harm types
Human or fundamental rightsPsychologicalReputational

AI system task:
Content generation


Articles about this incident or hazard