AI-Driven Deepfake Fraud Surges, Prompting Defensive Innovation

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Onfido's 2024 Identity Fraud Report reveals a 31-fold increase in AI-generated deepfake fraud and a fivefold rise in forged identities, driven by accessible generative AI tools. These attacks have caused significant financial and identity-related harm, prompting Onfido to launch an AI-powered Fraud Lab to counter escalating AI-enabled fraud.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves the use of AI systems (generative AI for deepfakes) in fraudulent activities that have directly led to harm, including financial fraud and unauthorized access to sensitive information. The article details the scale of the problem (3000% increase in fraud attempts) and the methods used by fraudsters, indicating realized harm rather than just potential risk. This fits the definition of an AI Incident because the AI system's use has directly led to significant harm to individuals and organizations through fraud.[AI generated]
AI principles
Privacy & data governanceRespect of human rightsSafetyRobustness & digital securityAccountabilityTransparency & explainability

Industries
Digital securityFinancial and insurance servicesIT infrastructure and hosting

Affected stakeholders
ConsumersBusiness

Harm types
Economic/PropertyHuman or fundamental rightsPsychological

AI system task:
Content generation


Articles about this incident or hazard