The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
A 13-year-old girl at Aliso Viejo Middle School became a victim when a classmate used AI software to create and share fake nude images of her, leading to harassment and emotional distress. The incident highlights how AI misuse is causing harm to minors, leaving schools and legal systems unprepared.[AI generated]
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems (AI software generating realistic nude images) to create harmful deepfake content targeting minors. This use has directly led to harm, including harassment, psychological harm, and violations of rights, fulfilling the criteria for an AI Incident. The article describes realized harm rather than potential harm, and the AI system's role is pivotal in enabling the creation and dissemination of the harmful images. Therefore, this is classified as an AI Incident.[AI generated]