AI-Generated Disinformation and Deepfakes Threaten 2024 Elections

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Ahead of 2024 elections, AI tools—from generative deepfake audio and video to chatbots—have been used to spread false claims, discredit candidates and mislead voters. Incidents include doctored clips targeting UK’s Wes Streeting, AI candidate ‘AI Steve’, X’s chatbot Grok tweeting voting deadline lies, and a deepfake audio undermining Slovakia’s opposition.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves AI systems explicitly through the creation and dissemination of deepfake audio and video content generated by AI tools. The use of these AI systems has directly led to harm by spreading disinformation that influenced election outcomes and public trust, which constitutes harm to communities and democratic processes. The article provides concrete examples of realized harm (e.g., the Slovakian election impact, viral manipulated content) rather than just potential risks. Therefore, this qualifies as an AI Incident because the AI system's use has directly caused significant harm through disinformation and manipulation of public opinion during elections.[AI generated]
AI principles
AccountabilityTransparency & explainabilityRobustness & digital securitySafetyDemocracy & human autonomyRespect of human rightsPrivacy & data governance

Industries
Media, social platforms, and marketingGovernment, security, and defenceDigital security

Affected stakeholders
General public

Harm types
Public interestReputationalHuman or fundamental rights

Severity
AI incident

AI system task:
Content generationInteraction support/chatbots


Articles about this incident or hazard

Thumbnail Image

Are concerns about digital disinformation and elections overblown? | Brookings

2024-08-08
Brookings
Why's our monitor labelling this an incident or hazard?
The article discusses AI-generated disinformation and its potential to influence elections, but it states that so far, no major AI-driven disinformation incidents have meaningfully affected elections. It highlights ongoing monitoring, mitigation efforts, and the complexity of attributing disinformation campaigns. The mention of the disrupted AI-enabled bot farm is a law enforcement success, not an incident of harm. The article's main focus is on evaluating the current situation, risks, and responses, which fits the definition of Complementary Information rather than an AI Incident or AI Hazard.
Thumbnail Image

Blurring Fact and Fiction - Ceylon Today

2024-08-10
CeylonToday
Why's our monitor labelling this an incident or hazard?
The event involves AI systems explicitly through the creation and dissemination of deepfake audio and video content generated by AI tools. The use of these AI systems has directly led to harm by spreading disinformation that influenced election outcomes and public trust, which constitutes harm to communities and democratic processes. The article provides concrete examples of realized harm (e.g., the Slovakian election impact, viral manipulated content) rather than just potential risks. Therefore, this qualifies as an AI Incident because the AI system's use has directly caused significant harm through disinformation and manipulation of public opinion during elections.
Thumbnail Image

Prospect Weekly Roundup: AI-Generated Elections

2024-08-09
The American Prospect
Why's our monitor labelling this an incident or hazard?
The AI system (X's AI chatbot Grok) is explicitly mentioned as spreading false information about election deadlines, and AI-generated deepfakes are being used to discredit a political figure. This disinformation is occurring during an active election and is influencing voters, which constitutes harm to communities by undermining the democratic process and potentially violating rights related to fair elections. Therefore, this is an AI Incident as the AI system's use has directly led to harm through disinformation dissemination.
Thumbnail Image

Beyond disinformation and deepfakes

2024-08-06
adalovelaceinstitute.org
Why's our monitor labelling this an incident or hazard?
The article explicitly describes multiple AI systems (e.g., AI chatbots, generative AI for deepfakes, AI-powered disinformation campaigns) that have been used in ways that have directly led to harms such as spreading false information, discrediting political figures, and influencing public opinion, which qualifies as AI Incidents. However, the article's main purpose is to analyze and summarize these various uses and their implications across different countries and elections, rather than reporting a single new event. It also discusses AI uses that counter disinformation and voter engagement tools, which do not themselves constitute harm but provide complementary context. Given the broad scope and analytical nature, the article fits best as Complementary Information, as it enhances understanding of AI's multifaceted role in elections and informs governance considerations without focusing on a single new incident or hazard.