South Korea Blocks 64 AI Deepfake Porn Sites for Rights Violations

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

South Korea's Broadcasting Media Communications Review Committee identified and blocked 64 overseas AI-powered sites generating non-consensual pornographic deepfake content using real people's images. The sites enabled easy creation and distribution of explicit material, causing significant harm. Authorities pledged ongoing monitoring and strict action against AI misuse.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly mentions AI systems used to generate sexual images and deepfake videos of real people without consent, which is a violation of human rights and causes harm to individuals and communities. The AI systems' outputs directly lead to harm through non-consensual sexual content creation and distribution. The blocking of these sites is a response to an ongoing AI Incident where harm is realized. Hence, the event qualifies as an AI Incident under the framework.[AI generated]
AI principles
Privacy & data governanceRespect of human rights

Industries
Media, social platforms, and marketing

Affected stakeholders
General public

Harm types
Human or fundamental rightsPsychologicalReputational

AI system task:
Content generation


Articles about this incident or hazard