Surge in Deepfake Sexual Crime Content in South Korea

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

South Korea has seen a sharp rise in deepfake sexual crime materials, with over 17,000 cases reviewed in the first eight months of the year, surpassing last year's total. AI-generated deepfake videos are fueling widespread harm, prompting calls for more effective measures to prevent distribution and protect victims.[AI generated]

Why's our monitor labelling this an incident or hazard?

Deepfake videos are created using AI systems that generate synthetic media, which directly relates to the AI system's use. The widespread distribution of deepfake sexual crime videos causes harm to individuals and communities, fulfilling the criteria for harm to communities and violations of rights. The article documents actual harm occurring, not just potential harm, and the AI system's role is pivotal in generating the harmful content. Hence, this is an AI Incident rather than a hazard or complementary information.[AI generated]
AI principles
Respect of human rightsPrivacy & data governance

Industries
Media, social platforms, and marketing

Affected stakeholders
Women

Harm types
PsychologicalReputationalHuman or fundamental rights

AI system task:
Content generation


Articles about this incident or hazard