UNICEF Warns of Global Surge in AI-Generated Child Sexual Abuse Material

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

UNICEF, supported by INTERPOL and ECPAT, reports a rapid global increase in AI-generated deepfake images sexually exploiting children, with at least 1.2 million victims across 11 countries. The agency urges criminalization, stronger safeguards by AI developers, and enhanced content moderation to address the widespread harm caused by these technologies.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves AI systems generating harmful content (deepfake sexual abuse images of minors), which directly leads to significant harm to children and communities, fulfilling the criteria for an AI Incident. The article describes realized harm (millions of reports of such content) and the direct role of AI in producing and spreading this content. Therefore, it is classified as an AI Incident rather than a hazard or complementary information.[AI generated]
AI principles
SafetyRespect of human rights

Industries
Media, social platforms, and marketing

Affected stakeholders
Children

Harm types
PsychologicalHuman or fundamental rights

AI system task:
Content generation


Articles about this incident or hazard