Surge in AI-Driven Deepfake Digital Sex Crimes in Korea

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

South Korea faces a rising wave of digital sex crimes using AI-generated deepfakes, heavily targeting women and young people. More than 10,000 victims have received support for counseling, content deletion, and legal aid as cases increase sharply, highlighting serious human rights breaches linked to the misuse of AI technology.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves the use of AI systems to generate deepfake sexual content, which has directly led to harm including violations of human rights, psychological harm, and social harm to victims. The crimes are ongoing and have resulted in arrests and legal actions, confirming realized harm. The AI system's role in creating synthetic media is pivotal to the harm described. Therefore, this qualifies as an AI Incident under the framework, as the AI-generated content has directly caused significant harm to individuals and communities.[AI generated]
AI principles
Respect of human rightsPrivacy & data governanceSafetyAccountabilityFairnessRobustness & digital securityTransparency & explainabilityHuman wellbeing
Industries
Media, social platforms, and marketingDigital securityGovernment, security, and defence
Affected stakeholders
WomenChildren
Harm types
Human or fundamental rightsPsychologicalReputational
Severity
AI incident
AI system task:
Content generation

Articles about this incident or hazard