AI-Generated Deepfake Video of Yogyakarta Governor Used in Scam

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

An AI-generated deepfake video impersonating Sri Sultan Hamengku Buwono X, Governor of Yogyakarta, circulated via WhatsApp and was used in a scam attempt. The local government confirmed the video was fake, warned the public, and prioritized digital literacy to prevent further harm from AI-enabled fraud and misinformation.[AI generated]

Why's our monitor labelling this an incident or hazard?

The video is explicitly identified as a deepfake created using AI, which manipulates the likeness and voice of a public figure to mislead viewers. The content directs individuals to make payments before receiving goods, a common fraud tactic, indicating direct harm to people through deception and potential financial loss. The involvement of AI in creating the deepfake is central to the harm, fulfilling the criteria for an AI Incident. The event is not merely a potential risk but an actual occurrence of harm facilitated by AI misuse.[AI generated]
AI principles
Transparency & explainabilityDemocracy & human autonomy
Industries
Media, social platforms, and marketing
Affected stakeholders
General publicGovernment
Harm types
Economic/PropertyReputationalPublic interest
Severity
AI incident
AI system task:
Content generation

Articles about this incident or hazard