The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
Generative AI is being used by criminal networks to produce, distribute, and monetize synthetic child sexual abuse content, exploiting at least 1.2 million children. The technology enables rapid manipulation of social media images, outpacing legal and investigative capacities, and causing significant harm to children and communities globally.[AI generated]
Why's our monitor labelling this an incident or hazard?
The event clearly involves AI systems (generative AI) used in the production and dissemination of synthetic child sexual abuse content, which is a direct violation of human rights and causes harm to children and communities. The article documents realized harm, including arrests and investigations, indicating that the AI's role is pivotal in the criminal activity. This fits the definition of an AI Incident because the AI system's use has directly led to significant harm (sexual exploitation and abuse of children).[AI generated]