Generative AI Drives Surge in Fraud and Deepfake Scams Globally

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Generative AI and deepfake technologies are fueling a sharp rise in fraud and identity theft, with businesses and individuals worldwide reporting increased financial losses and digital impersonation. Studies highlight a 3000% spike in deepfake attacks and significant challenges for organizations in combating AI-enabled fraud.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly links the rise in financial fraud losses to the use of generative AI, which has enabled fraudsters to conduct attacks more easily and at scale. The harms described include financial losses to individuals and organizations, identity theft, and account takeovers, which fall under harm to persons and property. The AI system's use in fraud generation is a direct contributing factor to these harms. Hence, this is an AI Incident as the AI system's use has directly led to realized harm.[AI generated]
AI principles
Robustness & digital securityPrivacy & data governanceRespect of human rightsSafetyTransparency & explainabilityAccountabilityHuman wellbeing

Industries
Digital securityFinancial and insurance servicesMedia, social platforms, and marketing

Affected stakeholders
ConsumersBusiness

Harm types
Economic/PropertyHuman or fundamental rightsReputationalPsychological

Severity
AI incident

Business function:
ICT management and information securityCitizen/customer serviceCompliance and justice

AI system task:
Content generationInteraction support/chatbots


Articles about this incident or hazard

Thumbnail Image

Fraud losses increasing in India, finds study - ETCFO

2024-02-14
ETCFO.com
Why's our monitor labelling this an incident or hazard?
The article discusses the role of generative AI as a factor contributing to increased fraud losses, implying a potential for AI-enabled fraud. However, it does not describe a concrete event where an AI system's development, use, or malfunction directly or indirectly caused harm. The focus is on a general trend and risk rather than a specific incident or hazard event. Therefore, this is best classified as Complementary Information, providing context and understanding about AI's impact on fraud trends without reporting a distinct AI Incident or AI Hazard.
Thumbnail Image

Financial frauds rise in India as GenAI gains traction - ET CISO

2024-02-16
ETCISO.in
Why's our monitor labelling this an incident or hazard?
The article explicitly links the rise in financial fraud losses to the use of generative AI, which has enabled fraudsters to conduct attacks more easily and at scale. The harms described include financial losses to individuals and organizations, identity theft, and account takeovers, which fall under harm to persons and property. The AI system's use in fraud generation is a direct contributing factor to these harms. Hence, this is an AI Incident as the AI system's use has directly led to realized harm.
Thumbnail Image

Q&A: AI and sophisticated scams targeting businesses and consumers in 2024

2024-02-15
Digital Journal
Why's our monitor labelling this an incident or hazard?
The article does not report a specific AI Incident where harm has already occurred due to AI misuse. Instead, it forecasts potential fraud threats involving AI and discusses how these could plausibly lead to harm in the future. It also provides complementary information on how businesses and consumers can prepare and respond to these threats. Therefore, the event is best classified as Complementary Information, as it enhances understanding of AI-related fraud risks and responses without describing a concrete AI Incident or imminent AI Hazard.
Thumbnail Image

India witnesses surge in fraudulent activities led by AI: Study - The Statesman

2024-02-17
The Statesman
Why's our monitor labelling this an incident or hazard?
The event involves the use of generative AI systems to conduct fraudulent activities that have directly led to financial harm to individuals and organizations, which qualifies as harm to property and economic interests. The AI system's use in enabling fraud constitutes the AI system's involvement in causing harm. Therefore, this event meets the criteria for an AI Incident as the AI system's use has directly led to realized harm (fraud losses).
Thumbnail Image

Protecting digital integrity in the age of deepfakes and identity fraud | Biometric Update

2024-02-15
Biometric Update
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems (generative AI and deepfake technologies) in the commission of identity fraud, which directly harms individuals and businesses by undermining digital trust and enabling impersonation. The harms described include violations of digital integrity and trust, disruption of access to online services, and facilitation of fraud, all of which fall under harm to communities and property. Since these harms are occurring and linked directly to the use of AI systems, this qualifies as an AI Incident rather than a hazard or complementary information.
Thumbnail Image

We won't be held responsible for AI fraud cases, BoU says

2024-02-14
The East African
Why's our monitor labelling this an incident or hazard?
The article involves AI systems in the context of AI-generated fraud, which is a recognized harm (financial fraud). However, it does not report a specific AI Incident where harm has already occurred due to AI fraud. Rather, it warns about the potential for such harm and outlines planned regulatory and risk management responses. Therefore, this event is best classified as an AI Hazard, as it plausibly could lead to AI Incidents involving financial harm, but no concrete incident is described yet.
Thumbnail Image

Financial sector to use AI solutions to counteract sophisticated fraud strategies - SAS

2024-02-15
Engineering News
Why's our monitor labelling this an incident or hazard?
The article primarily provides an overview of the financial sector's response to increasing fraud risks through AI solutions and discusses the dual-use nature of generative AI in fraud creation and detection. It does not report a concrete AI Incident (harm realized) or a specific AI Hazard (a particular event or circumstance with plausible imminent harm). Instead, it offers complementary information about the evolving AI ecosystem in financial crime prevention, including strategic, ethical, and technological considerations. Therefore, it fits best as Complementary Information rather than an Incident or Hazard.
Thumbnail Image

Fighting Fraud and Financial Crimes in the Generative AI age

2024-02-14
ITNewsAfrica.com
Why's our monitor labelling this an incident or hazard?
The article clearly involves AI systems, specifically generative AI and machine learning, in the context of financial crime. However, it does not describe any realized harm or a specific event where AI caused or almost caused harm. The harms discussed are potential and general, and the article focuses on strategies and ethical considerations to address these risks. This aligns with the definition of Complementary Information, as it provides supporting context and insights into AI's role in financial crime and anti-fraud efforts without reporting a new incident or hazard.
Thumbnail Image

Experian Sheds Light on the Changing Fraud Landscape

2024-02-15
fintechmagazine.com
Why's our monitor labelling this an incident or hazard?
The involvement of generative AI in enabling fraud constitutes the use of AI systems leading to realized harm (financial and identity-related) to individuals and businesses. Since the article states that fraud losses have increased and consumers feel more targeted due to AI-enabled fraud, this qualifies as an AI Incident under the definition of harm to persons and property caused directly or indirectly by AI use.