UK Authorities Warn of AI-Generated Child Sexual Abuse Images

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

UK authorities, including the National Crime Agency and Internet Watch Foundation, have warned parents against posting children's photos online due to a surge in AI-generated child sexual abuse material. AI systems are being misused to create realistic abusive images, causing significant harm and prompting new guidance to protect children.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves AI systems being misused to generate harmful and illegal content (CSAM), which directly causes harm to children and violates their rights. The presence of AI-generated CSAM and its increase is a clear example of an AI Incident, as the AI's use has directly led to significant harm. The article's focus is on the harm caused and the response to it, not just on general AI developments or warnings, so it is not merely Complementary Information or an AI Hazard. Therefore, this qualifies as an AI Incident.[AI generated]
AI principles
SafetyRespect of human rights

Industries
Media, social platforms, and marketingDigital security

Affected stakeholders
Children

Harm types
PsychologicalHuman or fundamental rights

Severity
AI incident

AI system task:
Content generation


Articles about this incident or hazard