The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
Four students at Thomas Alva Edison School in Ituzaingó, Argentina, used AI tools to generate and sell fake sexualized images of female classmates, including a seven-year-old. The images were created from real photos taken from social media. The incident led to formal complaints and a judicial investigation.[AI generated]
Why's our monitor labelling this an incident or hazard?
The event explicitly describes the use of AI tools to create manipulated sexual images of minors, which were then distributed and sold, constituting a serious violation of human rights and child protection laws. The AI system's use is central to the harm caused, fulfilling the criteria for an AI Incident. The harm includes exploitation, violation of rights, and psychological and social damage to the victims. The involvement of minors and the legal actions underway further confirm the severity and realized harm.[AI generated]