The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
Around 50 male students from two Buenos Aires schools used AI to manipulate photos of female classmates, creating and selling sexualized images without consent. School authorities activated gender violence protocols and legal measures in response to this digital harassment and rights violation.[AI generated]
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of AI to create manipulated images of students without their consent, which were circulated and sold, causing harm to the victims. This is a direct harm caused by the use of an AI system (image generation/manipulation) leading to violations of rights and digital violence. The involvement of AI in the creation of harmful content and its distribution meets the definition of an AI Incident under violations of human rights and harm to communities.[AI generated]