AI-Generated Fake Videos Spark Misinformation, YouTuber Prosecuted in South Korea

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A South Korean YouTuber used generative AI to create and spread false videos about sensitive topics, including national security and election fraud, inciting public anxiety. Police investigated and prosecuted the individual, freezing illicit profits. The AI-generated misinformation caused social harm and legal action was taken.[AI generated]

Why's our monitor labelling this an incident or hazard?

The use of a generative AI system to produce and disseminate false and misleading videos that inflame public anxiety and spread misinformation constitutes an AI Incident. The AI system's outputs directly led to harm by misleading the public and potentially disrupting social order. The event meets the criteria for an AI Incident because the AI-generated content caused realized harm through misinformation and social disruption.[AI generated]
AI principles
Transparency & explainabilityDemocracy & human autonomy
Industries
Media, social platforms, and marketing
Affected stakeholders
General public
Harm types
PsychologicalPublic interest
Severity
AI incident
AI system task:
Content generation

Articles about this incident or hazard