AI Deepfakes Used to Impersonate Chinese Celebrities in Livestream Scams

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

AI-generated deepfake videos and audio impersonating Chinese celebrities, including Wu Yue and Deng Yaping, were used on WeChat Video accounts to fraudulently promote products and scam consumers. The platform permanently banned the offending account, but the incident highlights ongoing risks of AI misuse for identity theft and fraud in China.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves AI systems used for deepfake impersonation, which directly leads to harm by defrauding people through fake livestreams. This constitutes a violation of rights and harm to communities due to misinformation and fraud. The permanent ban of the account is a response to this harm. The article also covers broader governance and legal frameworks addressing AI misuse, but the central event is the realized harm caused by AI deepfake impersonation. Therefore, this qualifies as an AI Incident.[AI generated]
AI principles
Transparency & explainabilityPrivacy & data governance
Industries
Media, social platforms, and marketing
Affected stakeholders
ConsumersOther
Harm types
Economic/PropertyReputational
AI system task:
Content generation

Articles about this incident or hazard