AI Face-Swapping and Deepfake Apps Cause Widespread Harm and Legal Action in China

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

AI face-swapping and 'undressing' apps have been used in China to create fake explicit images and videos, violating individuals' portrait and privacy rights, damaging reputations, and causing psychological harm. Legal cases have resulted in rulings against app operators, highlighting the urgent need for regulation and responsible AI use to prevent further abuse.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly describes AI systems (AI face-swapping and undressing apps) being used maliciously to create fake images and videos that harm individuals' rights and reputations, constituting realized harm. It details the social and legal consequences of these harms and ongoing efforts to combat them. Therefore, this qualifies as an AI Incident because the AI system's use has directly led to violations of rights and social harm.[AI generated]
AI principles
AccountabilityPrivacy & data governanceRespect of human rightsSafetyHuman wellbeing

Industries
Media, social platforms, and marketing

Affected stakeholders
General public

Harm types
Human or fundamental rightsReputationalPsychological

AI system task:
Content generation


Articles about this incident or hazard