EU Proposes Criminal Penalties for AI-Generated Child Sexual Abuse Material

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

The European Commission has proposed stricter laws to criminalize the creation, possession, and distribution of child sexual abuse material generated by AI, including deepfakes and AI chatbots used for abuse. The move responds to a surge in AI-enabled exploitation, aiming to close legal gaps and better protect children.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event explicitly involves AI systems generating hyperrealistic deepfake images and videos of child sexual abuse, which directly harms children and violates their rights. The article discusses the legal response to this harm, indicating that such AI-generated content is already present and causing damage. The AI system's use in producing illegal and harmful content meets the definition of an AI Incident because it has directly led to violations of human rights and harm to communities. The regulatory update is a response to an existing AI Incident rather than a mere potential hazard or complementary information.[AI generated]
AI principles
Respect of human rightsHuman wellbeingSafetyAccountability

Industries
Media, social platforms, and marketing

Affected stakeholders
Children

Harm types
PsychologicalHuman or fundamental rights

AI system task:
Content generationInteraction support/chatbots


Articles about this incident or hazard