AI Voice Cloning Scams Prompt National Security Warning in China

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Chinese authorities warn that criminals use AI to clone voiceprints from a few seconds of phone conversation, enabling identity fraud and scams. The public is advised to remain silent for three seconds when answering unknown calls to prevent voice data theft. AI-driven biometric data misuse threatens personal and national security.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves the use and misuse of AI systems for voice cloning and biometric data extraction, which directly leads to harm in the form of fraud and deception causing financial and psychological damage to individuals. The AI system's involvement is explicit and central to the harm described. Therefore, this qualifies as an AI Incident because the AI system's use has directly led to realized harm to people through scams and identity fraud.[AI generated]
AI principles
Privacy & data governanceSafety

Industries
Digital securityGovernment, security, and defence

Affected stakeholders
General publicGovernment

Harm types
Economic/PropertyHuman or fundamental rightsPublic interest

AI system task:
Content generation


Articles about this incident or hazard