The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
A Semarang university student used AI deepfake technology to manipulate his ex-girlfriend's face onto pornographic images and videos, distributing them on social media. The victim suffered severe psychological distress and reputational harm. Police arrested and detained the perpetrator, who faces legal action for violating privacy and human rights.[AI generated]
Why's our monitor labelling this an incident or hazard?
The event describes a clear AI Incident because the AI system was used to create deepfake content that harmed the victim by spreading false and explicit images, which is a violation of personal rights and privacy. The harm is realized and direct, as the victim suffered from the malicious use of AI-generated content. The involvement of AI in generating the manipulated images meets the definition of an AI system, and the resulting harm fits under violations of human rights and harm to communities. Therefore, this is classified as an AI Incident.[AI generated]