AI-Generated Child Sexual Abuse Material Drives Surge in Exploitation Cases in North America

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Police in Canada and the US report a sharp rise in child sexual exploitation cases linked to AI-generated abuse material. Offenders use AI to create explicit images from innocent photos, impersonate individuals, and facilitate sextortion, making detection and investigation more difficult and increasing harm to victims.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly mentions AI-generated child sexual abuse material as a factor in the rise of exploitation cases. The AI system's role in creating realistic but fake images/videos of children directly contributes to harm by facilitating abuse, victimization, and legal challenges. This constitutes a violation of rights and harm to communities, fitting the definition of an AI Incident. The harm is realized and ongoing, not merely potential, and the AI system's involvement is pivotal in the described exploitation cases.[AI generated]
AI principles
Respect of human rightsSafety

Industries
Digital security

Affected stakeholders
Children

Harm types
PsychologicalHuman or fundamental rights

AI system task:
Content generation


Articles about this incident or hazard