South Korean Police Officer Arrested for AI-Generated Sexual Exploitation Material

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A South Korean police officer was arrested for creating and distributing AI-generated fake nude videos of acquaintances and possessing thousands of illegal sexual exploitation materials. The officer used AI apps to fabricate over 400 fake videos and shared them via Telegram, continuing the crimes even after joining the police force.[AI generated]

Why's our monitor labelling this an incident or hazard?

An AI system was explicitly used to create sexual exploitation material, which constitutes a violation of human rights and applicable laws protecting individuals from such harm. The distribution of these materials caused direct harm to individuals and communities, fulfilling the criteria for an AI Incident. The involvement of AI in generating the content and its use in illegal distribution is central to the harm caused.[AI generated]
AI principles
Privacy & data governanceRespect of human rights
Industries
Consumer services
Affected stakeholders
Other
Harm types
Human or fundamental rightsPsychologicalReputational
AI system task:
Content generation

Articles about this incident or hazard