
The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
AI systems using deep learning and GANs have enabled the creation and mass distribution of deepfake videos, particularly non-consensual pornographic content and blackmail material. These AI-generated deepfakes have caused significant harm to individuals and communities, including psychological distress, privacy violations, and exploitation, especially in regions lacking clear legal protections.[AI generated]
Why's our monitor labelling this an incident or hazard?
The article explicitly describes AI systems (deep learning, GANs) used to create deepfake videos and images, including malicious uses such as non-consensual pornographic deepfakes generated by AI bots on Telegram. These uses have directly led to harm to individuals (violation of rights, exploitation) and communities (harm from misinformation and exploitation). The article also references legislative responses and detection technologies as complementary information but the main focus is on the harms caused by AI-generated deepfakes that are currently occurring. Hence, this qualifies as an AI Incident under the framework because the AI system's use has directly led to violations of rights and harm to communities.[AI generated]