AI-Generated Deepfakes Disrupt South Korean Election Campaigns

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

South Korea's National Election Commission detected 129 AI-generated deepfake videos and images violating election law ahead of parliamentary elections. The use of deepfakes for electoral campaigning is banned due to their potential to spread disinformation and undermine democratic processes, prompting increased vigilance and legal action by authorities.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves an AI system generating deepfake audio that directly misled voters, constituting harm to communities by spreading misinformation that could influence election outcomes. This meets the criteria for an AI Incident because the AI-generated deepfake has already caused harm through misinformation and election interference. The article also discusses legislative and governance responses, but the primary focus is on the realized harm from AI misuse in the election context.[AI generated]
AI principles
AccountabilityTransparency & explainabilityRespect of human rightsRobustness & digital securitySafetyDemocracy & human autonomy

Industries
Media, social platforms, and marketingGovernment, security, and defenceDigital security

Affected stakeholders
General public

Harm types
Public interestReputationalHuman or fundamental rights

Severity
AI incident

AI system task:
Content generation

In other databases

Articles about this incident or hazard

Thumbnail Image

Tech giants sign voluntary pledge to fight election-related deepfakes

2024-02-16
Yahoo News
Why's our monitor labelling this an incident or hazard?
The article clearly involves AI systems (deepfake generation and AI-voiced robocalls) that have caused or are causing harm to communities by spreading misleading election-related content, which qualifies as an AI Incident. However, the article's primary focus is on the voluntary pledge by tech companies to fight these harms and the broader regulatory and societal context, rather than detailing a new specific incident or hazard. The examples of harms mentioned are background context to the main narrative about the pledge and responses. Therefore, this article is best classified as Complementary Information, as it provides important context and updates on responses to ongoing AI-related harms rather than reporting a new incident or hazard itself.
Thumbnail Image

Could AI sway the 2024 election? Here's what's being done nationally to stop deepfakes.

2024-02-19
Yahoo News
Why's our monitor labelling this an incident or hazard?
The event involves an AI system generating deepfake audio that directly misled voters, constituting harm to communities by spreading misinformation that could influence election outcomes. This meets the criteria for an AI Incident because the AI-generated deepfake has already caused harm through misinformation and election interference. The article also discusses legislative and governance responses, but the primary focus is on the realized harm from AI misuse in the election context.
Thumbnail Image

Deepfake porn is a huge problem -- here are some of the tools that could help stop it

2024-02-18
Business Insider
Why's our monitor labelling this an incident or hazard?
The event involves AI systems used to create deepfake pornographic content, which has directly led to significant harm to individuals, including psychological trauma and a reported suicide. This fits the definition of an AI Incident as the AI system's use has directly led to harm to people (harm to health and communities). The article also discusses responses and tools to combat this harm, but the primary focus is on the realized harm caused by AI deepfakes, not just potential or complementary information.
Thumbnail Image

Deepfakes swirl in S. Korea ahead of general elections | Yonhap News Agency

2024-02-19
Yonhap News Agency
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems to generate deepfake videos and images that have been actively disseminated to mislead voters and influence elections, which is a violation of law and harms the integrity of the democratic process (harm to communities). The AI system's use has directly led to this harm, fulfilling the criteria for an AI Incident. The article also discusses the authorities' response but the primary focus is on the ongoing harm caused by AI-generated deepfakes.
Thumbnail Image

Deepfakes Surge Ahead Of General Elections In South Korea

2024-02-19
Zee News
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI-generated deepfake content being detected and used in election contexts, which constitutes misinformation and disinformation that harms communities and the democratic process, a form of harm to communities and violation of rights. Since the harm is occurring (e.g., AI-generated videos falsely endorsing candidates), this qualifies as an AI Incident. The article also discusses the authorities' efforts to combat this harm, but the primary focus is on the realized harm caused by AI deepfakes in elections, not just potential future harm or complementary information.
Thumbnail Image

FTC seeks to modify rule to combat deepfakes | TechCrunch

2024-02-15
TechCrunch
Why's our monitor labelling this an incident or hazard?
The event involves AI systems (deepfake generation and voice cloning) that are being used maliciously to impersonate individuals and organizations, which can lead to significant harm to consumers through fraud and misinformation. However, the article primarily describes the FTC's regulatory proposal and the broader context of AI-enabled impersonation risks rather than a specific incident where harm has already occurred. Therefore, this is best classified as Complementary Information, as it provides important context and governance response to an ongoing AI-related risk without reporting a concrete AI Incident or an immediate AI Hazard.
Thumbnail Image

Deepfake cases surge ahead of general elections in South Korea: What are the issues?

2024-02-19
India TV News
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI-generated deepfake content being detected and used in electoral campaigning, which is illegal and harmful. The harm includes spreading false information and misleading voters, which impacts the democratic process and community trust. The AI system's use has directly led to these harms, fulfilling the criteria for an AI Incident. The article also references past incidents and ongoing challenges in detection, reinforcing the realized harm caused by AI misuse.
Thumbnail Image

April 10 elections under threat from AI deepfake manipulation

2024-02-19
The Korea Times
Why's our monitor labelling this an incident or hazard?
The article explicitly involves AI systems generating deepfake content that has been used to misinform voters and potentially influence election outcomes, which constitutes harm to communities and a violation of legal frameworks protecting fair elections. The National Election Commission has identified 129 instances of such content violating the Public Official Election Act, indicating realized harm. Therefore, this qualifies as an AI Incident because the AI system's use has directly led to violations of law and harm to the democratic process. The discussion of legal measures and public awareness efforts is complementary but does not overshadow the primary incident of harm caused by AI deepfakes.
Thumbnail Image

Deepfakes swirl in S. Korea ahead of general elections

2024-02-19
The Korea Herald
Why's our monitor labelling this an incident or hazard?
The event involves AI systems generating deepfake media that have been detected and are being used in electoral campaigning, which is illegal and harmful. The harm includes misinformation and manipulation of public opinion, which impacts democratic rights and community trust. The article explicitly states that such AI-generated content has been found and is subject to legal penalties, confirming realized harm. Hence, this is an AI Incident as the AI system's use has directly led to violations of rights and harm to communities.
Thumbnail Image

Major Tech Companies Unite to Combat Deceptive AI in Global Elections

2024-02-19
Tech Times
Why's our monitor labelling this an incident or hazard?
The article does not report an AI Incident because it does not describe any realized harm caused by AI systems; rather, it discusses a proactive, collective effort to prevent such harms. It also does not describe an AI Hazard in the sense of a specific event or circumstance that could plausibly lead to harm, but instead outlines a strategic response to known risks. Therefore, it fits best as Complementary Information, providing context on governance and societal responses to AI-related risks in elections.
Thumbnail Image

Deepfake Dangers: Rise of AI-Generated Pornography Sparks Global Concerns

2024-02-18
Tech Times
Why's our monitor labelling this an incident or hazard?
The article explicitly involves AI systems used to generate deepfake images and videos, which have directly led to significant harms such as nonconsensual pornography, blackmail, and reputational damage. These harms constitute violations of human rights and harm to individuals and communities. The article also references concrete incidents (e.g., deepfake porn of Taylor Swift) and ongoing harm, qualifying it as an AI Incident. The discussion of responses and protections is complementary but does not overshadow the primary focus on realized harms caused by AI deepfakes.
Thumbnail Image

Deepfakes: South Korea Election Authorities Raise Concerns Over Proliferation of Artificial Intelligence-Generated Deepfake Videos and Images Amid Parliamentary Elections in April | 📲 LatestLY

2024-02-19
LatestLY
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI-generated deepfake media content being detected and considered a violation of election law, indicating the use of AI systems to create misleading content that can harm democratic processes and public trust. The harm here is the spread of false information and manipulation of public opinion during elections, which constitutes harm to communities and a violation of democratic rights. Since the deepfakes have already been detected and are actively influencing the electoral environment, this is a realized harm scenario. Therefore, this qualifies as an AI Incident due to the direct involvement of AI-generated content causing harm to the electoral process and society.
Thumbnail Image

Deepfakes surge ahead of general elections in S. Korea

2024-02-19
Social News XYZ
Why's our monitor labelling this an incident or hazard?
The event involves AI systems generating deepfake content that is actively being used to mislead voters and influence elections, which constitutes harm to communities and a violation of legal frameworks protecting democratic rights. The detection of 129 AI-generated deepfakes and the reference to past incidents where such content was circulated demonstrate that harm is materializing, not just a potential risk. Hence, this qualifies as an AI Incident because the AI system's use has directly led to harm through misinformation and election interference.
Thumbnail Image

Deepfake Regulation Considered Under Jamaican Cybercrimes Act

2024-02-18
Cryptopolitan
Why's our monitor labelling this an incident or hazard?
The article does not describe a realized AI Incident where harm has occurred due to AI-generated deepfakes, nor does it report a specific event where AI misuse has directly caused injury, rights violations, or other harms. Instead, it discusses the potential for harm and the need for regulation and legal frameworks to address such risks. This aligns with the definition of an AI Hazard or Complementary Information. However, since the article mainly focuses on the ongoing policy debate, legal interpretations, and regulatory responses rather than a direct or imminent threat or event, it fits best as Complementary Information, providing context and updates on governance and societal responses to AI-related risks.
Thumbnail Image

Deepfake porn is a huge problem -- here are some of the tools that could help stop it

2024-02-18
Business Insider Nederland
Why's our monitor labelling this an incident or hazard?
The article clearly identifies AI systems generating deepfake pornographic content that has caused direct harm to individuals, including psychological trauma and social harm, which fits the definition of an AI Incident. It also discusses the use and misuse of AI in creating harmful content and the resulting legal and technological responses. Since the harms are occurring and linked directly to AI-generated deepfakes, this qualifies as an AI Incident rather than a hazard or complementary information.
Thumbnail Image

Hawaii Legislators Seek To Crack Down On AI-Generated Political Misinformation

2024-02-19
Honolulu Civil Beat
Why's our monitor labelling this an incident or hazard?
The article centers on bills being proposed to address the threat of AI-generated deepfakes used in political misinformation. It acknowledges the potential for harm to election integrity but does not describe any realized harm or incident caused by AI systems. The AI system involvement is clear (deepfake generation using AI), and the harm is potential (plausible future harm to elections and communities). Therefore, this event qualifies as an AI Hazard rather than an AI Incident or Complementary Information. It is not unrelated because it directly concerns AI-generated content and its societal impact.
Thumbnail Image

Deepfakes surge ahead of general elections in S. Korea - Weekly Voice

2024-02-19
Weekly Voice
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI-generated deepfake content being detected and used in election-related disinformation, which has already occurred and is a violation of election law. This use of AI-generated deepfakes to mislead voters and manipulate public opinion constitutes harm to communities and the democratic process, fulfilling the criteria for an AI Incident. The involvement of AI systems in generating deepfakes is clear, and the harm is direct and ongoing. Therefore, this event is classified as an AI Incident.
Thumbnail Image

Deepfakes Surge Ahead Of General Elections In South Korea AI-generated deepfake videos and images are on the rise in South Korea, prompting concerns and

2024-02-19
Bollyinside - Breaking & latest News worldwide
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI-generated deepfake content being used in electoral campaigning, which is prohibited by law due to its potential to spread false information and disrupt the election process. The detection of 129 pieces of such content confirms that harm is materializing, specifically harm to communities and the democratic process. The AI system's use in creating deepfakes directly leads to violations of election integrity, fitting the definition of an AI Incident. The article also discusses responses by authorities, but the primary focus is on the realized harm caused by AI-generated disinformation.
Thumbnail Image

Deepfakes Surge Ahead Of General Elections In South Korea | Technology News Newly revised election law in South Korea prohibits the use of deepfakes for

2024-02-19
Bollyinside - Breaking & latest News worldwide
Why's our monitor labelling this an incident or hazard?
The presence of AI systems is clear as deepfakes are AI-generated synthetic media. The article focuses on the potential for harm (disinformation affecting elections) and the legislative and verification responses to mitigate this risk. Since no actual harm or incident is reported, but a credible risk is identified along with proactive measures, this fits the definition of Complementary Information. It provides context and updates on governance responses to AI-related risks without describing a realized AI Incident or an imminent AI Hazard.
Thumbnail Image

Could AI sway the 2024 election? Here's what's being done nationally to stop deepfakes.

2024-02-19
USA Today
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions an AI system generating deepfake audio that impersonated a political figure to misinform voters, which is a direct use of AI causing harm to the democratic process and communities. The misinformation could influence voter behavior and election outcomes, fulfilling the criteria for harm to communities. The article also discusses legal and governance responses, but these are complementary to the primary incident of AI-driven election interference. Hence, the classification is AI Incident.
Thumbnail Image

Deepfake porn is a huge problem -- here are some of the tools that could help stop it

2024-02-18
Business Insider India
Why's our monitor labelling this an incident or hazard?
The article clearly describes an AI Incident because AI systems (generative models like Stable Diffusion, DALL-E, etc.) are being used to create deepfake pornographic content that has caused real harm to individuals, including trauma and even death. The harm is direct and significant, involving violations of personal rights and psychological injury. The discussion of detection and regulatory responses serves as complementary information but does not negate the fact that the core issue is an ongoing AI Incident involving realized harm. Therefore, the event is best classified as an AI Incident.
Thumbnail Image

大型科技公司簽署協議,將打擊虛偽AI資訊對選舉的干擾-MoneyDJ理財網

2024-02-22
MoneyDJ理財網
Why's our monitor labelling this an incident or hazard?
The article does not report an actual AI incident where AI-generated misinformation has caused harm but rather a governance and societal response to the potential threat of AI-generated election interference. This fits the definition of Complementary Information, as it provides context on efforts to mitigate AI-related harms rather than describing a new incident or hazard itself.
Thumbnail Image

科技大咖聯手 抗選舉假訊息

2024-02-18
Yahoo!奇摩股市
Why's our monitor labelling this an incident or hazard?
The event involves AI systems (generative AI tools capable of producing text, images, and videos) and addresses the risk of their misuse to spread false information that could harm democratic processes (harm to communities). However, the article does not report any realized harm or incidents caused by AI misuse; rather, it highlights a proactive, voluntary agreement to prevent such misuse. Therefore, this is an AI Hazard, as the misuse of AI could plausibly lead to harm in the future, but no direct or indirect harm has yet occurred according to the article.
Thumbnail Image

AI生成假消息 2024年全球最大風險 | Anue鉅亨 - 國際政經

2024-02-22
Anue鉅亨
Why's our monitor labelling this an incident or hazard?
The event involves AI systems capable of generating false information that could influence elections, which is a plausible risk of harm to communities and political processes. Since the article emphasizes the potential for harm and ongoing efforts to address these risks without describing a realized harm or specific incident, it fits the definition of an AI Hazard. There is no direct or indirect evidence of an AI Incident occurring yet, and the article is not merely complementary information as it centers on the risk itself rather than responses or updates to past events.
Thumbnail Image

20家科技巨擘承諾 聯手對抗選舉AI假訊息

2024-02-18
中時新聞網
Why's our monitor labelling this an incident or hazard?
The article focuses on a proactive, voluntary commitment by companies to prevent potential misuse of AI in election interference. While it acknowledges the plausible risk of AI-generated misinformation affecting elections, no actual harm or incident has occurred as described. Therefore, this is a credible AI Hazard scenario, where AI systems could plausibly lead to harm in the future if misused, but no direct or indirect harm has yet materialized.
Thumbnail Image

全球科技業者承諾將力抗今年選舉的AI欺騙

2024-02-19
iThome Online
Why's our monitor labelling this an incident or hazard?
The article does not report any actual harm caused by AI systems yet, but rather a proactive, coordinated effort to prevent AI-generated deceptive content from interfering with elections. The AI systems involved are generative AI models capable of producing audio, video, and images that could be used maliciously. Since the event focuses on preventing potential harms and outlines measures to reduce risks, it fits the definition of an AI Hazard, where AI use could plausibly lead to harm (election interference, misinformation) if not addressed. There is no indication that harm has already occurred, so it is not an AI Incident. It is more than just complementary information because it centers on the risk and mitigation commitments rather than updates on past incidents or general AI news.
Thumbnail Image

韓國國會選舉在即 AI生成的競選虛假信息引發擔憂

2024-02-19
hkcna.hk
Why's our monitor labelling this an incident or hazard?
The event involves AI systems generating deepfake videos and images used as false information in an election context, which is explicitly stated. The use of AI-generated false content has already occurred and has been detected by election authorities, indicating realized harm to the integrity of the election and potentially to communities. This fits the definition of an AI Incident because the AI system's use has directly led to harm (disruption of democratic processes and harm to communities). The article also describes legal and enforcement responses, but the primary focus is on the incident of AI-generated misinformation itself, not just the response, so it is not merely Complementary Information.