AI-Generated Deepfakes Fuel Scams, Identity Theft, and Election Manipulation

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Generative AI tools like DALL-E, Midjourney, and Sora are enabling the widespread creation of deepfake images and videos, making it difficult to distinguish real from fake. These AI-generated fakes are increasingly used for scams, identity theft, and manipulating elections, causing significant harm to individuals and communities.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly describes AI generative systems (e.g., DALL-E, Midjourney) being used to create deepfake content that is actively causing harm such as scams, identity theft, and political manipulation. These harms fall under harm to communities and violations of rights. The AI systems' use is directly linked to these harms, meeting the criteria for an AI Incident. The discussion of detection tools and advice is complementary but does not overshadow the primary focus on realized harms caused by AI-generated deepfakes.[AI generated]
AI principles
AccountabilityPrivacy & data governanceRespect of human rightsRobustness & digital securitySafetyTransparency & explainabilityDemocracy & human autonomy
Industries
Media, social platforms, and marketingDigital securityGovernment, security, and defence
Affected stakeholders
General public
Harm types
Economic/PropertyPsychologicalReputationalPublic interestHuman or fundamental rights
AI system task:
Content generation

Articles about this incident or hazard