AI-Generated Deepfakes Cause Harm and Prompt Legal Action in US and South Korea

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

AI-generated deepfakes have caused significant harm, including the creation of non-consensual explicit content and manipulation of political discourse. In the US, the FTC is enforcing laws requiring tech platforms to remove such content, while South Korea is implementing strict regulations to curb deepfake misuse ahead of elections. Children have been notably victimized by deepfake abuse.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves AI systems (deepfake generation tools) that have been used to create harmful non-consensual explicit content, causing real harm to individuals, including psychological harm and potential harassment or extortion. The FTC's enforcement of the law is a response to these harms. Since the AI system's use has directly led to violations of rights and harm, this qualifies as an AI Incident under the framework, specifically under harm to individuals and violations of rights. The article focuses on the enforcement action addressing an existing harm caused by AI-generated content, not just potential harm or general AI news, so it is not a hazard or complementary information.[AI generated]
AI principles
Respect of human rightsAccountability

Industries
Media, social platforms, and marketing

Affected stakeholders
ChildrenGeneral public

Harm types
Human or fundamental rightsPsychologicalPublic interest

AI system task:
Content generation


Articles about this incident or hazard