AI-Generated Deepfake Impersonation of Japanese Defense Minister Prompts Warning

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Japanese Defense Minister Shinjiro Koizumi warned the public after reports of fraudulent calls using AI-generated video and audio to impersonate him via WeChat. The sophisticated scam involved individuals posing as his secretary and connecting victims to deepfake video calls, prompting police involvement and public caution.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly mentions AI-generated video and audio impersonating a politician, used in fraudulent video calls during an election. This involves an AI system's use (generative AI for deepfakes) leading directly to harm: deception, misinformation, and potential election-related harm. The harm is realized, not just potential, as multiple people have received suspicious calls. This fits the definition of an AI Incident due to violation of rights (misinformation, impersonation) and harm to communities (election interference risk).[AI generated]
AI principles
SafetyDemocracy & human autonomy
Industries
Digital securityGovernment, security, and defence
Affected stakeholders
ConsumersGeneral public
Harm types
Economic/Property
Severity
AI incident
AI system task:
Content generation

Articles about this incident or hazard