AI-Generated Fake Suspect Image Disrupts Murder Investigation in Tongyeong

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

In Tongyeong, South Korea, an AI-generated synthetic image falsely depicting a murder suspect circulated widely online, causing misinformation, xenophobic speculation, and confusion. The fake image disrupted police investigation efforts and led authorities to clarify its inauthenticity, urging the public to refrain from spreading false information.[AI generated]

Why's our monitor labelling this an incident or hazard?

An AI system was explicitly used to generate a synthetic image of a crime suspect, which is a manipulated output designed to mislead. This AI-generated content has been widely disseminated on social media, causing harm by inciting ethnic hatred and false accusations against a specific group. This constitutes harm to communities, a recognized category of AI harm. The AI system's use is central to the harm, making this an AI Incident rather than a hazard or complementary information. The event does not describe a plausible future harm but an ongoing harm caused by the AI-generated content.[AI generated]
AI principles
Respect of human rightsTransparency & explainability
Industries
Government, security, and defenceMedia, social platforms, and marketing
Affected stakeholders
GovernmentGeneral public
Harm types
Public interestPsychological
Severity
AI incident
AI system task:
Content generation

Articles about this incident or hazard