Surge in AI-Driven Deepfake and Forced Verification Fraud Across Europe and North America

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Sumsub reports a dramatic rise in AI-enabled deepfake and forced verification fraud in the UK, Europe, and North America. Deepfake cases and liveness bypass attacks have surged, replacing traditional forgery methods and leading to increased financial and identity fraud across multiple industries, highlighting significant harm from malicious AI use.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly mentions the use of AI systems (deepfake technology and AI-based verification systems) being exploited for fraudulent purposes, which directly leads to harm through identity fraud and financial scams. The increase in forced verification and deepfake fraud cases indicates realized harm rather than just potential risk. Therefore, this event qualifies as an AI Incident because the AI system's use has directly led to harm (fraud and associated impacts).[AI generated]
AI principles
Privacy & data governanceRespect of human rightsRobustness & digital securitySafetyTransparency & explainabilityAccountabilityHuman wellbeing

Industries
Digital securityFinancial and insurance servicesMedia, social platforms, and marketingConsumer services

Affected stakeholders
ConsumersBusiness

Harm types
Economic/PropertyReputationalHuman or fundamental rightsPsychological

Business function:
ICT management and information securityCompliance and justiceMonitoring and quality controlCitizen/customer service

AI system task:
Content generation


Articles about this incident or hazard