AI-Generated Deepfake Video of Malaysian King Used in Financial Scam

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Malaysian police are investigating a TikTok video that uses AI-generated images to impersonate King Sultan Ibrahim, falsely offering financial aid and directing viewers to a scammer. The deepfake video, identified as fraudulent, has prompted warnings and legal action due to its deceptive use of AI technology in a financial scam.[AI generated]

Why's our monitor labelling this an incident or hazard?

The video was identified as fake and created using AI, which directly contributes to a scam that can cause harm to individuals (financial harm and deception). This fits the definition of an AI Incident because the AI system's use in generating the fake video has directly led to harm through fraudulent activity and potential victimization.[AI generated]
AI principles
AccountabilityTransparency & explainabilityRobustness & digital securitySafetyPrivacy & data governanceDemocracy & human autonomy
Industries
Media, social platforms, and marketingFinancial and insurance servicesDigital security
Affected stakeholders
Consumers
Harm types
Economic/PropertyReputationalPublic interest
Severity
AI incident
AI system task:
Content generation

Articles about this incident or hazard

Thumbnail Image

Video of the King offering monetary aid on social media is fake, says police

2025-07-21
The Star
Why's our monitor labelling this an incident or hazard?
The video was identified as fake and created using AI, which directly contributes to a scam that can cause harm to individuals (financial harm and deception). This fits the definition of an AI Incident because the AI system's use in generating the fake video has directly led to harm through fraudulent activity and potential victimization.
Thumbnail Image

Police investigate TikTok scam using AI-generated video of Malaysian King

2025-07-22
Malay Mail
Why's our monitor labelling this an incident or hazard?
An AI system was used to generate a realistic fake video of a public figure to deceive people into a financial scam. This misuse of AI has directly led to harm by misleading the public and potentially causing financial harm, fulfilling the criteria for an AI Incident. The police investigation confirms the harm is occurring and the AI-generated content is central to the scam.
Thumbnail Image

Police report lodged over scam video using AI-generated likeness of Agong

2025-07-21
Free Malaysia Today
Why's our monitor labelling this an incident or hazard?
The video uses AI-generated likeness of the Agong to impersonate him and promote a fraudulent financial assistance offer, which constitutes a direct harm through deception and potential financial loss to victims. The police report and ongoing investigation confirm that harm has occurred or is occurring due to the AI system's use. Therefore, this qualifies as an AI Incident due to realized harm caused by the AI-generated content used in a scam.
Thumbnail Image

Police Report Lodged Over Scam Video Using AI-Generated Images Of King

2025-07-21
BERNAMA
Why's our monitor labelling this an incident or hazard?
The video uses AI-generated images of the King to create a misleading message that is part of a scam, directly causing harm by deceiving people and potentially leading to financial loss. The AI system's involvement in generating the images is central to the incident, fulfilling the criteria for an AI Incident due to realized harm through fraudulent use of AI-generated content.
Thumbnail Image

Police report lodged over AI scam video using King's fake images

2025-07-22
thesun.my
Why's our monitor labelling this an incident or hazard?
The video uses AI-generated images to impersonate the King of Malaysia and falsely announce financial aid, directing viewers to contact a scammer. This constitutes a misuse of AI-generated content leading to a scam, which is a violation of rights and causes harm to individuals targeted by the fraud. Therefore, this is an AI Incident due to the realized harm from the AI system's use in the scam.