AI Deepfakes Fuel Election Misinformation and Non-Consensual Pornography Crisis

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Generative AI tools are increasingly used to create deepfake images, audio, and videos, leading to widespread misinformation in elections and a surge in non-consensual deepfake pornography. These AI-generated fakes harm individuals’ rights, distort democratic processes, and present significant challenges for detection and prevention.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly mentions AI systems generating deepfake content (images, audio, video) that is being disseminated on social media and flagged as false, indicating realized harm. The use of AI-generated deepfakes in political contexts can mislead voters and distort democratic processes, constituting harm to communities. The AI systems' development and use have directly contributed to this harm. Although some content is labeled as parody, the broader phenomenon of AI deepfakes spreading misinformation is a clear AI Incident under the OECD framework, as it involves violations of rights to truthful information and harms communities. The article does not merely warn about potential future harm but documents ongoing issues and examples, confirming it as an AI Incident rather than a hazard or complementary information.[AI generated]
AI principles
AccountabilityPrivacy & data governanceRespect of human rightsRobustness & digital securitySafetyTransparency & explainabilityDemocracy & human autonomyHuman wellbeing

Industries
Media, social platforms, and marketingGovernment, security, and defenceDigital security

Affected stakeholders
General publicWomen

Harm types
Human or fundamental rightsPublic interestPsychologicalReputational

AI system task:
Content generation


Articles about this incident or hazard