AI-Powered Deepfakes Spread Misinformation and Deceive Public Figures

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

AI-driven deepfake and voice cloning technologies have enabled the creation of convincing fake videos, such as fabricated endorsements by Joe Rogan and Andrew Huberman. These manipulated videos, easily made and widely shared on social media, have caused reputational harm and spread misinformation, highlighting the societal risks of accessible AI tools.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly mentions AI systems used to create deepfakes and voice-cloned videos that have been widely disseminated and have misled viewers, including fake endorsements and false political statements. These AI systems have directly led to harm by spreading misinformation and disinformation, which harms communities and violates rights to truthful information. The presence of AI is clear from the description of voice cloning and video manipulation technologies. The harms are realized and ongoing, not merely potential. Hence, this is an AI Incident rather than a hazard or complementary information.[AI generated]
AI principles
AccountabilitySafetyTransparency & explainabilityRespect of human rightsPrivacy & data governanceDemocracy & human autonomy

Industries
Media, social platforms, and marketing

Affected stakeholders
General public

Harm types
ReputationalPublic interest

Severity
AI incident

AI system task:
Content generation

In other databases


Articles about this incident or hazard

Thumbnail Image

Making Deepfakes Gets Cheaper and Easier Thanks to A.I.

2023-03-12
The New York Times
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI systems used to create deepfakes and voice-cloned videos that have been widely disseminated and have misled viewers, including fake endorsements and false political statements. These AI systems have directly led to harm by spreading misinformation and disinformation, which harms communities and violates rights to truthful information. The presence of AI is clear from the description of voice cloning and video manipulation technologies. The harms are realized and ongoing, not merely potential. Hence, this is an AI Incident rather than a hazard or complementary information.
Thumbnail Image

Making deepfakes gets cheaper and easier, thanks to AI

2023-03-12
The Straits Times
Why's our monitor labelling this an incident or hazard?
The article explicitly discusses AI systems used to create deepfake videos and voice clones that have been disseminated widely, causing misinformation and deception. This misinformation can harm communities by distorting truth and misleading the public, which fits the definition of harm to communities under AI Incident criteria. The harm is realized, not just potential, as videos have gone viral and caused confusion or reputational damage. The AI systems' use is central to the harm, fulfilling the criteria for an AI Incident rather than a hazard or complementary information.
Thumbnail Image

Making deepfake videos is getting cheaper and easier thanks to AI - The Boston Globe

2023-03-12
The Boston Globe
Why's our monitor labelling this an incident or hazard?
The event involves AI systems explicitly, namely AI-powered deepfake and voice cloning technologies used to create manipulated videos. These AI systems have been used to produce and spread false and misleading content that harms individuals (e.g., reputational harm to public figures) and communities (e.g., misinformation affecting public discourse and trust). The harm is realized and ongoing, as viral videos have deceived viewers and caused social harm. Therefore, this qualifies as an AI Incident because the AI system's use has directly led to violations of rights and harm to communities through misinformation and deception.
Thumbnail Image

Making deepfakes gets cheaper and easier thanks to AI

2023-03-12
Deccan Herald
Why's our monitor labelling this an incident or hazard?
The event involves AI systems explicitly, namely AI-powered deepfake and voice cloning technologies. These AI systems have been used to create manipulated videos and audio that have directly led to harms such as misinformation, deception, and potential societal harm (harm to communities). The article documents actual instances of such content circulating widely and causing confusion or harm, fulfilling the criteria for an AI Incident. Although some responses and mitigations are mentioned, the primary focus is on the realized harms caused by AI-generated deepfakes, not just potential future risks or responses, so it is not merely Complementary Information or an AI Hazard.
Thumbnail Image

Making deepfakes gets cheaper and easier thanks to AI | eKathimerini.com

2023-03-14
Ekathimerini
Why's our monitor labelling this an incident or hazard?
The article explicitly discusses AI systems used to create deepfake videos and voice clones that have been disseminated widely, causing misinformation and deception. This has led to harm to communities by spreading false information and potentially influencing public opinion and trust. The AI systems' use is central to the creation and spread of these harmful fakes. Hence, this qualifies as an AI Incident because the AI system's use has directly led to realized harm, not just a potential hazard or complementary information.