AI-Generated Deepfakes Cause Real-World Harm and Spur Global Regulatory Action

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

AI-generated deepfakes have been used to spread misinformation, defame public figures, and incite social unrest, notably in the Israel-Hamas conflict and through scams targeting businesses and individuals. These incidents have led to financial loss, reputational damage, and threats to democracy, prompting governments worldwide to consider or enact regulations to mitigate AI-driven harms.[AI generated]

Why's our monitor labelling this an incident or hazard?

The report explicitly links the use of AI systems (deepfake generation tools) to realized harms including fraud scams causing financial losses, misinformation threatening democracy, and reputational damage from synthetic pornographic videos. These harms fall under violations of rights and harm to communities. Since the harms are occurring and the AI system's use is central to these harms, this qualifies as an AI Incident. The article also discusses potential future risks and policy responses, but the presence of realized harm takes precedence.[AI generated]
AI principles
AccountabilityTransparency & explainabilityRobustness & digital securitySafetyPrivacy & data governanceRespect of human rightsDemocracy & human autonomyHuman wellbeing

Industries
Media, social platforms, and marketingDigital securityFinancial and insurance servicesGovernment, security, and defenceConsumer services

Affected stakeholders
General publicBusiness

Harm types
Economic/PropertyReputationalPublic interestHuman or fundamental rightsPsychological

Severity
AI incident

AI system task:
Content generation


Articles about this incident or hazard

Thumbnail Image

Canada flags deepfakes as a societal threat

2023-11-29
CoinGeek
Why's our monitor labelling this an incident or hazard?
The report explicitly links the use of AI systems (deepfake generation tools) to realized harms including fraud scams causing financial losses, misinformation threatening democracy, and reputational damage from synthetic pornographic videos. These harms fall under violations of rights and harm to communities. Since the harms are occurring and the AI system's use is central to these harms, this qualifies as an AI Incident. The article also discusses potential future risks and policy responses, but the presence of realized harm takes precedence.
Thumbnail Image

Deepfakes, luxury bags and Ramayana: Unmasking the deepfake trend

2023-11-30
The Times of India
Why's our monitor labelling this an incident or hazard?
The article explicitly describes deepfakes as AI-generated manipulated videos used with harmful intent, including financial fraud and misinformation, which have already caused harm to individuals and communities. This fits the definition of an AI Incident because the use of AI systems (deepfake generation) has directly led to harm through deception, misinformation, and fraud. Although the article also provides historical and cultural context, the core focus is on the realized harms caused by AI deepfake technology.
Thumbnail Image

Michigan to join state-level effort to regulate AI political ads as...

2023-11-29
Daily Mail Online
Why's our monitor labelling this an incident or hazard?
The event involves AI systems (generative AI creating deepfakes) and addresses the potential for harm (misleading political ads, election interference). However, the article focuses on the introduction of regulations and preventive measures rather than reporting an actual AI-caused harm incident. Therefore, it represents a plausible risk of harm that the legislation aims to mitigate, fitting the definition of an AI Hazard rather than an AI Incident or Complementary Information.
Thumbnail Image

Michigan to pass law demanding transparency in AI-generated political ads

2023-11-29
Fox News
Why's our monitor labelling this an incident or hazard?
The article does not report an actual AI Incident or AI Hazard but rather details legislative and policy measures being taken to address the potential harms of AI-generated deepfakes in political ads. The main focus is on transparency laws and governance responses to mitigate risks, which fits the definition of Complementary Information. There is no direct or indirect harm reported as having occurred, nor is there a specific event of plausible harm from AI use described beyond the general risk context. Therefore, this is best classified as Complementary Information.
Thumbnail Image

Seeing isn't believing: From Gaza to US politics, deepfake videos are peddling fake news

2023-11-27
Yahoo Sports Canada
Why's our monitor labelling this an incident or hazard?
The article clearly describes realized harms caused by AI systems generating deepfake videos that spread false information and manipulate public perception, leading to potential social and political harm. These harms include misinformation affecting communities, reputational damage to individuals, and risks of violent unrest. Since the AI system's use has directly led to these harms, this qualifies as an AI Incident under the framework. The article does not merely warn of potential future harm but documents ongoing and realized impacts of deepfakes.
Thumbnail Image

Seeing isn't believing: From Gaza to US politics, deepfake videos are peddling fake news

2023-11-27
USA Today
Why's our monitor labelling this an incident or hazard?
The article clearly describes how AI systems (deepfake generation technologies) have been used to create manipulated videos that have directly led to harms including misinformation, reputational damage, and potential social unrest. These harms fall under violations of rights and harm to communities. Since the harms are occurring and the AI system's use is central to these harms, this qualifies as an AI Incident. The article does not merely warn about potential future harms but documents ongoing impacts and societal consequences of deepfake videos generated by AI.
Thumbnail Image

Tech Talk | Not Just Rashmika & Alia, All Women are Potential Deepfake Victims. What are AI Leaders Doing? - News18

2023-11-30
News18
Why's our monitor labelling this an incident or hazard?
The article clearly describes realized harm caused by AI systems (deepfake technology) through the creation and dissemination of non-consensual manipulated videos targeting women, which constitutes harm to individuals and communities. It also discusses ongoing responses and detection efforts but focuses primarily on the harm and its mitigation. Therefore, this qualifies as an AI Incident because the misuse of AI has directly led to violations of rights and harm to individuals. The article does not describe a new hazard or only complementary information but reports on an existing and ongoing harm caused by AI misuse.
Thumbnail Image

The worst fallout of deepfake would be a 'trust no one' world

2023-11-27
The Financial Express
Why's our monitor labelling this an incident or hazard?
Deepfakes are AI-generated synthetic media, and the article explicitly mentions their use in manipulating political elections, spreading misinformation, and creating non-consensual pornography. These uses have directly led to harms including violations of rights, harm to communities, and potential disruption of democratic processes. Since these harms are occurring and linked to the use of AI systems (deepfake generation), this qualifies as an AI Incident under the framework. The article does not merely warn about potential future harms but documents realized harms and ongoing impacts.
Thumbnail Image

Deepfake menace: How to spot and shield yourself from fake images, videos on internet

2023-11-28
The Financial Express
Why's our monitor labelling this an incident or hazard?
The article clearly involves AI systems as deepfakes are generated by AI technologies. The harms described (misinformation, reputation damage, fraud) fall under harm to communities and individuals. However, the article does not report a specific event where these harms have materialized; it rather warns about the potential dangers and educates readers on detection and protection. Therefore, this is a plausible future harm scenario, fitting the definition of an AI Hazard rather than an AI Incident or Complementary Information.
Thumbnail Image

This election season was flooded with deepfakes. Govt must bring out a robust policy

2023-12-01
ThePrint
Why's our monitor labelling this an incident or hazard?
The article clearly identifies that AI-generated deepfakes have been actively used during elections, causing harm to communities by spreading misinformation and violating privacy rights, which fits the definition of an AI Incident. The harms are realized and ongoing, not merely potential. However, the article's main focus is on advocating for policy responses and describing existing legal frameworks and challenges, which aligns with Complementary Information. Since the article does not report a new specific AI Incident event but rather discusses the broader context and responses to existing harms, the classification as Complementary Information is appropriate.
Thumbnail Image

Telangana's KT Rama Rao falls prey to deepfake menace: How AI is wreaking havoc for politicians

2023-11-30
Firstpost
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of AI systems (deepfake technology) to create manipulated videos and audios that misrepresent politicians, leading to misinformation and voter confusion during elections. This constitutes harm to communities and a violation of democratic rights, as the AI-generated content is used to mislead voters and disrupt fair political processes. The harm is realized, not just potential, as the videos have circulated and affected public perception. Therefore, this qualifies as an AI Incident under the framework, as the AI system's use has directly led to harm in the political and social domain.
Thumbnail Image

Michigan to join state-level effort to regulate AI political ads as federal legislation pends

2023-11-29
Newsday
Why's our monitor labelling this an incident or hazard?
The article centers on legislative and regulatory efforts to address the risks posed by AI-generated deepfakes in political advertising, aiming to prevent deceptive uses that could harm democratic processes. While it acknowledges the potential for harm from AI misuse, it does not report a specific AI Incident where harm has occurred, nor does it describe a particular AI Hazard event with imminent risk. Instead, it provides complementary information about governance and societal responses to AI-related risks in political ads, including new laws, proposed bills, and platform policies. Therefore, it fits the definition of Complementary Information rather than an AI Incident or AI Hazard.
Thumbnail Image

JOHAN STEYN: The devil's in the deepfake

2023-11-29
BusinessLIVE
Why's our monitor labelling this an incident or hazard?
The article explicitly discusses AI systems (deepfake technology using AI and machine learning) being used to create realistic but fake videos and images that have caused real harm, such as scams deceiving people, reputational damage through non-consensual pornography, and misinformation. These harms fall under violations of rights and harm to communities. The AI system's use directly led to these harms, meeting the criteria for an AI Incident rather than a hazard or complementary information.
Thumbnail Image

Michigan to join state-level effort to regulate AI political ads as federal legislation is pending

2023-11-29
Democratic Underground
Why's our monitor labelling this an incident or hazard?
The article describes a state-level policy initiative aimed at preventing deceptive uses of AI in political ads, addressing concerns about potential future harms such as misinformation and election interference. However, it does not report any realized harm or incident caused by AI systems. Therefore, it is best classified as Complementary Information, as it provides governance context and societal response to AI-related risks without describing a specific AI Incident or Hazard.
Thumbnail Image

Michigan to join state-level effort to regulate AI political ads as federal legislation pends

2023-11-29
KTAR News
Why's our monitor labelling this an incident or hazard?
The article centers on regulatory and policy measures addressing the potential harms of AI-generated political ads, especially deepfakes, which could mislead voters and undermine elections. While it acknowledges the risks and examples of AI-generated content used in political ads, it does not report any realized harm or incidents directly caused by AI systems. Instead, it highlights legislative and governance responses to mitigate these risks. Therefore, this is best classified as Complementary Information, as it provides context and updates on societal and governance responses to AI-related risks without describing a specific AI Incident or AI Hazard.
Thumbnail Image

Digital Manipulation - Greater Kashmir

2023-11-30
Greater Kashmir
Why's our monitor labelling this an incident or hazard?
The article describes the potential harms of deepfakes created by AI systems and the challenges in detecting them, which aligns with the concept of AI Hazards since these harms could plausibly occur. However, since no specific realized harm or incident is reported, and the focus is on the general threat and detection strategies rather than a concrete event, it does not qualify as an AI Incident. It is also not merely complementary information about responses or governance, but rather a discussion of the hazard deepfakes pose. Therefore, the classification as an AI Hazard is appropriate.
Thumbnail Image

Michigan to join state-level effort to regulate AI political ads as federal legislation is pending

2023-11-29
WBOC TV-16
Why's our monitor labelling this an incident or hazard?
The article focuses on the potential for AI-generated deepfakes and manipulated media in political ads to mislead voters and disrupt democratic processes, which constitutes a plausible risk of harm to communities and elections. However, no specific incident of harm or violation has been reported as having occurred yet. The legislative and regulatory responses described are proactive measures to mitigate this risk. Therefore, the event qualifies as an AI Hazard because it involves the plausible future harm from AI systems (generative AI creating deepfakes) in political advertising, but no realized harm or incident is detailed.
Thumbnail Image

2024's election cycle faces risk from deepfakes

2023-11-28
Verdict
Why's our monitor labelling this an incident or hazard?
The article clearly involves AI systems, specifically generative AI used to create deepfakes. The harms discussed relate to misinformation and potential damage to democracy, which constitute harm to communities and human rights. However, the article does not describe any realized harm or incident where deepfakes have directly or indirectly caused harm in the 2024 election cycle. Instead, it emphasizes the risk and the need for regulation to prevent such harm. Therefore, this event is best classified as an AI Hazard, as it plausibly could lead to significant harm but no specific incident has yet occurred.
Thumbnail Image

States look to legislation to regulate AI political ads next election

2023-11-30
KOAA
Why's our monitor labelling this an incident or hazard?
The event involves AI systems (deepfake generation using AI) and their potential misuse in political ads, which could plausibly lead to harm such as misinformation and harm to communities. Since no actual harm has been reported yet, but credible concerns and legislative actions are underway to prevent such harm, this qualifies as an AI Hazard. The article's main focus is on the plausible future harm and regulatory responses, not on a realized incident or harm.
Thumbnail Image

Michigan to join state-level effort to regulate AI political ads as federal legislation pends - Seymour Tribune

2023-11-29
The Tribune
Why's our monitor labelling this an incident or hazard?
The article primarily discusses a policy and regulatory response to the potential harms posed by AI-generated deepfakes in political advertising. While it acknowledges existing uses of AI-generated content that could mislead voters, it does not report a specific AI Incident where harm has already occurred due to AI misuse. Instead, it highlights ongoing and planned legislative and governance measures to address these risks. Therefore, this is best classified as Complementary Information, as it provides context on societal and governance responses to AI-related risks rather than describing a direct AI Incident or an imminent AI Hazard.
Thumbnail Image

Deepfake is a big challenge in the era of Artificial Intelligence

2023-11-30
Kashmir Images Newspaper
Why's our monitor labelling this an incident or hazard?
The article describes realized harms caused by AI systems (deepfake generation) including misinformation, reputational damage, social unrest, and election interference, which constitute harm to communities and violations of rights. It references specific past incidents where deepfakes have been used maliciously and caused harm. Therefore, this qualifies as an AI Incident because the use of AI-generated deepfakes has directly and indirectly led to significant harms. The article also discusses responses and solutions, but the primary focus is on the harms already occurring due to deepfakes.
Thumbnail Image

Sophisticated Manipulation Techniques Misrepresent Reality in Israel-Hamas Conflict

2023-11-30
worldreportnow.com
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of AI algorithms to create deepfakes that distort reality and spread misinformation in an ongoing conflict. This manipulation has already occurred and is causing harm to communities by fueling political tensions and inciting violence, which fits the definition of an AI Incident. The AI system's outputs are directly linked to the harm described, fulfilling the criteria for an AI Incident rather than a hazard or complementary information.
Thumbnail Image

States look to legislation to regulate AI political ads next election

2023-11-30
Scripps News
Why's our monitor labelling this an incident or hazard?
The article centers on the potential future harm posed by AI-generated deepfakes in political ads and the legislative measures being considered or enacted to mitigate these risks. Since no actual harm or incident has occurred yet, and the focus is on preventing or regulating plausible future misuse, this qualifies as an AI Hazard. It is not an AI Incident because no realized harm is described, nor is it Complementary Information since it is not updating or responding to a past incident. It is also not unrelated because it clearly involves AI systems (deepfake generation) and their societal implications.
Thumbnail Image

Why should businesses care about deepfake technology

2023-11-28
Techcircle
Why's our monitor labelling this an incident or hazard?
The article explicitly describes deepfake technology as an AI system (using generative adversarial networks and machine learning) that has been used maliciously to create synthetic media causing harm, such as loan scams and potential misinformation affecting businesses and society. These harms include financial loss, reputational damage, and threats to democracy, which fall under harms to communities and violations of rights. The mention of actual arrests for deepfake-enabled scams confirms realized harm, qualifying this as an AI Incident. The article also discusses ongoing regulatory and detection efforts as complementary information but the main focus is on the harms caused and the risks posed by deepfakes. Hence, the event is best classified as an AI Incident.