The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
A man on the Pune-Kolhapur Special Express in India secretly photographed a Muslim woman in a burqa and used AI (ChatGPT) to generate obscene images of her without consent. The incident was recorded by another passenger, leading to police intervention and sparking public outrage over AI misuse and women's safety.[AI generated]
Why's our monitor labelling this an incident or hazard?
The event explicitly describes the use of an AI system (ChatGPT) to manipulate images to create obscene content without consent, which is a direct violation of the woman's rights and causes harm to her. The AI system's use is central to the harm, and the incident has materialized with police involvement. This fits the definition of an AI Incident as the AI system's use has directly led to harm (violation of rights and harm to the individual).[AI generated]