AI-Enabled Fraud and Data Leaks Highlight Security Risks in China

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

In China, criminals used AI to synthesize facial verification videos, bypassing security checks and causing victims financial loss and fraudulent debt. Separately, misconfigured AI tools lacking proper access controls led to internal data exposure, creating significant data leakage risks. Both incidents underscore the dangers of improper AI use and configuration.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves the use of AI systems (AI-generated synthetic facial verification videos) in the commission of fraud that causes direct financial harm to individuals, which qualifies as harm to property and individuals. The AI system's use is central to the scam's success, making this an AI Incident under the definition of an event where AI use has directly led to harm.[AI generated]
AI principles
Privacy & data governanceRobustness & digital security
Industries
Financial and insurance servicesDigital security
Affected stakeholders
ConsumersBusiness
Harm types
Economic/PropertyReputationalHuman or fundamental rights
Business function:
ICT management and information security
AI system task:
Content generation

Articles about this incident or hazard