Korean Election Commission Takes Legal Action Over Deepfake Election Ads

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

The Central Election Commission has charged three individuals for using AI-generated deepfake videos and images to influence the 21st presidential election. The content, including manipulated images and AI news formats targeting specific candidates, violates new election laws designed to protect election integrity.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event explicitly involves AI systems used to generate deepfake videos and images that are false and intended to influence election results, which constitutes a violation of legal rights and harms the democratic process. The legal action taken confirms that harm has occurred due to the AI system's use. Therefore, this qualifies as an AI Incident because the AI system's use directly led to harm to communities and violation of legal rights.[AI generated]
AI principles
Transparency & explainabilityAccountabilityDemocracy & human autonomyRespect of human rightsSafetyFairness

Industries
Government, security, and defenceMedia, social platforms, and marketing

Affected stakeholders
General public

Harm types
ReputationalPublic interestHuman or fundamental rights

Severity
AI incident

Business function:
Marketing and advertisement

AI system task:
Content generation


Articles about this incident or hazard

Thumbnail Image

선관위, 딥페이크 첫 고발...'이재명·김문수 허위영상' 유튜버 법적조치 | 연합뉴스

2025-05-29
연합뉴스
Why's our monitor labelling this an incident or hazard?
The event explicitly involves AI systems used to generate deepfake videos and images that are false and intended to influence election results, which constitutes a violation of legal rights and harms the democratic process. The legal action taken confirms that harm has occurred due to the AI system's use. Therefore, this qualifies as an AI Incident because the AI system's use directly led to harm to communities and violation of legal rights.
Thumbnail Image

선관위, 딥페이크 이용 선거운동 첫 고발..."李·金 허위 이미지 생성"

2025-05-29
아시아경제
Why's our monitor labelling this an incident or hazard?
The event explicitly involves AI-generated deepfake content used in election campaigning, which is prohibited by law. The deepfakes have been produced and disseminated with the intent to influence election outcomes negatively, causing harm to the candidates' reputations and potentially misleading voters. This meets the criteria for an AI Incident as the AI system's use has directly led to a violation of legal rights and harm to the community's democratic process. The legal action taken by the election commission confirms the harm has materialized.
Thumbnail Image

"죄수복 입은 대선 후보"...선관위, 딥페이크 이용 선거운동 첫 고발

2025-05-29
국민일보
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems (deepfake technology) to create realistic but fake audio-visual content aimed at influencing election results. This use of AI directly leads to harm by spreading misinformation and potentially undermining the fairness of the election, which is a harm to communities and a violation of legal rights. Since the harm is realized (the videos were produced and distributed), this qualifies as an AI Incident rather than a hazard or complementary information.
Thumbnail Image

대선 후보에 죄수복 입혀 조작... 선관위, 딥페이크 선거운동 첫 고발 | 한국일보

2025-05-29
한국일보
Why's our monitor labelling this an incident or hazard?
The event explicitly involves AI systems used to generate deepfake images and videos, which are manipulated content created by AI. The AI-generated content was used maliciously to influence an election, which is a clear harm to communities and a violation of legal frameworks protecting fair elections. The fact that the election commission has taken legal action confirms the harm has materialized. Therefore, this qualifies as an AI Incident due to the direct use of AI-generated manipulated content causing harm in the political and social domain.
Thumbnail Image

중앙선관위, 제21대 대선 딥페이크 영상 이용 선거운동 첫 고발

2025-05-29
데일리중앙
Why's our monitor labelling this an incident or hazard?
The article explicitly states that AI technology was used to create deepfake videos and images that were posted online to influence voters in the presidential election. This use of AI directly led to legal violations and harms the integrity of the election process, which is a harm to communities and a violation of legal rights. The event involves the use of AI systems (deepfake generation) and the resulting harm has materialized, meeting the criteria for an AI Incident rather than a hazard or complementary information.
Thumbnail Image

선관위, 딥페이크 첫 고발...'이재명·김문수 허위영상' 유튜버 법적조치

2025-05-29
연합뉴스TV
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of AI technology to create deepfake videos that are difficult to distinguish from real footage, which were used to influence voters by promoting or demoting certain candidates. This use of AI-generated content has directly led to harm by spreading false information and violating election laws, which protect fundamental democratic rights. The legal action taken by the election commission confirms the recognition of harm caused by the AI system's misuse. Therefore, this event qualifies as an AI Incident due to the direct harm caused by the AI system's use in producing and distributing false election-related content.
Thumbnail Image

선관위, 21대 대선 딥페이크 이용 선거운동 첫 고발

2025-05-29
이투데이
Why's our monitor labelling this an incident or hazard?
The event involves AI systems explicitly through the use of AI-generated deepfake videos and images. The development and use of these AI systems for producing misleading election content directly caused harm by violating election laws and potentially misleading voters, which is a violation of fundamental rights and harms the community's democratic integrity. Since the harm has already occurred and legal action is underway, this qualifies as an AI Incident rather than a hazard or complementary information.
Thumbnail Image

중앙선관위, 대선 딥페이크 영상 게시 선거운동 3명 고발

2025-05-29
포인트경제
Why's our monitor labelling this an incident or hazard?
The event explicitly involves AI systems used to generate deepfake audiovisual content that is indistinguishable from real footage. The use of these AI-generated deepfakes to influence election outcomes constitutes a violation of legal frameworks protecting fair elections and potentially harms democratic processes and communities. Since the AI-generated content has been posted and is actively used in election campaigning, this is a realized harm, not just a potential risk. Therefore, this qualifies as an AI Incident due to the direct involvement of AI in causing harm through illegal electioneering activities.
Thumbnail Image

선관위, '이재명‧김문수' 딥페이크 이미지 제작 유튜버 첫 고발...법 신설 후 첫 사례

2025-05-29
쿠키뉴스
Why's our monitor labelling this an incident or hazard?
The event explicitly involves AI systems used to generate deepfake images and videos that misrepresent political candidates, which is a direct use of AI technology. The use of these AI-generated materials to influence voter perception and election results constitutes harm to communities and a violation of legal frameworks protecting fair elections. Since the harmful AI-generated content has been produced and distributed, and legal action has been taken, this qualifies as an AI Incident rather than a hazard or complementary information.