The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
A 14-year-old student in San Justo, Argentina, used AI tools to create fake nude images of classmates from their social media photos. The manipulated images were widely shared via WhatsApp, causing psychological distress and school absences among the victims. Authorities are investigating the incident.[AI generated]
Why's our monitor labelling this an incident or hazard?
The event explicitly describes the use of AI to digitally remove clothing from images of minors, creating non-consensual explicit content that was then shared widely, causing harm to the victims' mental health and social well-being. The AI system's use directly led to violations of the victims' rights and significant harm, fulfilling the criteria for an AI Incident. The involvement of minors and the legal investigation further underscore the seriousness of the harm caused. This is not merely a potential risk or a complementary update but a realized harm caused by AI misuse.[AI generated]