Deepfake AI Technology Causes Harm Through Fraud and Misinformation

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

AI-powered deepfake technology has enabled the creation and spread of highly realistic fake videos and audio, leading to financial fraud, reputational damage, and widespread misinformation. Incidents include scams using synthetic voices and videos, such as a fake Mark Zuckerberg video, deceiving individuals and undermining public trust.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly discusses the use of AI systems (deep learning-based deepfake technology) to create manipulated audio-visual content that is false and potentially harmful. The production of unethical deepfake videos of actors is a direct example of harm to individuals and communities through misinformation and violation of personal rights. Therefore, this event qualifies as an AI Incident because the AI system's use has directly led to harm in the form of misleading content and potential rights violations.[AI generated]
AI principles
AccountabilityTransparency & explainabilityDemocracy & human autonomySafetyHuman wellbeing

Industries
Media, social platforms, and marketing

Affected stakeholders
ConsumersBusinessGeneral public

Harm types
Economic/PropertyReputationalPublic interest

AI system task:
Content generation


Articles about this incident or hazard