South Korean Police Crack Down on AI-Generated Deepfake Sexual Exploitation Crimes

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

South Korean police arrested over 1,500 individuals, nearly half of them teenagers, for producing and distributing AI-generated deepfake sexual exploitation materials. The crackdown targeted illegal sites and social media platforms, with 87 suspects jailed. The use of AI deepfake technology directly contributed to cyber sexual violence and extortion, causing significant harm.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves the use of AI systems (deepfake technology) to create harmful sexual fake videos, which were then distributed and used for extortion and other crimes. This directly caused harm to individuals and communities, including violations of rights and psychological harm. The police action and arrests confirm that the harm has materialized. Hence, it meets the criteria for an AI Incident due to direct harm caused by AI system use in criminal activity.[AI generated]
AI principles
Respect of human rightsPrivacy & data governance

Industries
Media, social platforms, and marketing

Affected stakeholders
General public

Harm types
PsychologicalEconomic/PropertyHuman or fundamental rights

AI system task:
Content generation


Articles about this incident or hazard