AI-Generated Deepfakes Disrupt Elections and Defraud Businesses

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

AI-generated deepfakes are being used in political campaigns in Victoria, Australia, to mislead voters and erode trust in democracy. Simultaneously, businesses worldwide face costly deepfake-driven fraud, with some suffering losses exceeding $1 million. The incidents highlight the growing harm caused by AI-generated misinformation and impersonation.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves the use of AI systems to generate deepfake videos that are actively disseminated as political advertisements, directly causing misinformation and erosion of trust in democratic institutions. This fits the definition of an AI Incident because the AI system's use has directly led to harm to communities and democratic processes (harm category d). The article describes actual ongoing harm rather than potential or future harm, and the AI system's role is pivotal in creating and spreading the deepfakes. Therefore, the classification is AI Incident.[AI generated]
AI principles
Democracy & human autonomyTransparency & explainability

Industries
Media, social platforms, and marketingFinancial and insurance services

Affected stakeholders
General publicBusiness

Harm types
Public interestEconomic/Property

AI system task:
Content generation


Articles about this incident or hazard