AI-Generated Deepfake Pornography Sparks Digital Sex Crime Crisis in South Korea

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

In South Korea, AI systems are being used to create non-consensual deepfake pornographic images, primarily targeting women and causing significant psychological and reputational harm. A dedicated team at the National Center for Digital Sexual Crime Response in Seoul is working to detect and remove this illegal content from the internet.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves AI systems used to generate deepfake pornographic content without consent, which directly harms individuals by violating their rights and causing psychological trauma. The article explicitly states that these AI-generated deepfakes are widespread and have led to significant harm, including legal responses and victim support. The AI system's role in creating the harmful content is central and directly linked to the harm described, meeting the criteria for an AI Incident under violations of human rights and harm to communities.[AI generated]
AI principles
Privacy & data governanceRespect of human rights

Industries
Media, social platforms, and marketing

Affected stakeholders
Women

Harm types
PsychologicalReputational

AI system task:
Content generation


Articles about this incident or hazard