UNICEF Reports AI-Generated Child Sexual Abuse Content Affecting Millions

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

UNICEF's report reveals that in 21 countries, 1.1 million children were depicted in AI-generated sexual content, contributing to a broader crisis where 20 million children experienced sexual exploitation or abuse on digital platforms within a year. The incidents primarily occurred on social media, highlighting AI's role in facilitating harm.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves AI systems generating sexual content involving children, which is a direct violation of human rights and causes significant harm to the affected children. The UNICEF report documents that 1.1 million children experienced AI-generated sexual content about themselves, indicating realized harm. The AI system's role in producing such content is pivotal to the harm, fulfilling the criteria for an AI Incident. The harm includes violations of rights, emotional and psychological injury, and exploitation facilitated by AI technologies on digital platforms.[AI generated]
AI principles
Respect of human rightsSafety

Industries
Media, social platforms, and marketing

Affected stakeholders
Children

Harm types
Human or fundamental rightsPsychological

AI system task:
Content generation


Articles about this incident or hazard