
The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
A teenage student in Incheon, South Korea, used AI-based deepfake technology to create and distribute non-consensual sexual images of teachers, causing severe psychological harm. The student was prosecuted, and victims testified about lasting trauma. The incident highlights the misuse of AI for sexual exploitation and its profound impact on victims.[AI generated]
Why's our monitor labelling this an incident or hazard?
The article explicitly states that the defendant used AI-based deepfake technology to create and distribute fake sexual images of teachers, which constitutes a direct violation of their rights and causes psychological harm. This meets the criteria for an AI Incident because the AI system's use directly led to harm (psychological trauma, violation of rights) and legal consequences. The involvement of AI in the creation of harmful content and its distribution on social media platforms confirms the presence of an AI system causing realized harm.[AI generated]