AI-Generated Deepfakes Used for Fraud and Identity Theft in China

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

In China, criminals used AI-generated dynamic face and voice deepfakes to bypass facial recognition systems and commit identity theft and fraud, resulting in the theft of personal information and financial harm. The incidents highlight the growing risks of AI misuse and the urgent need for stronger security and regulatory measures.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves the use of AI systems (AI-generated deepfake facial videos) to commit identity fraud and unauthorized access, directly causing harm to individuals through theft and misuse of personal information, which constitutes a violation of rights and harm to communities. The AI system's use was central to the incident, enabling the criminals to bypass security measures. Therefore, this qualifies as an AI Incident under the framework, as the AI system's use directly led to realized harm.[AI generated]
AI principles
Privacy & data governanceRobustness & digital security

Industries
Digital securityFinancial and insurance services

Affected stakeholders
Consumers

Harm types
Economic/PropertyHuman or fundamental rights

AI system task:
Content generation


Articles about this incident or hazard