Uploader Arrested for AI-Generated Deepfake Video of President Jokowi as Egyptian Queen

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Indonesian police arrested a Twitter user for uploading an AI-generated deepfake video that replaced the face of Egyptian Queen Nefertiti with President Jokowi's. The video went viral, sparking public controversy and accusations of defamation, leading authorities to detain the uploader for further investigation.[AI generated]

Why's our monitor labelling this an incident or hazard?

The video is an AI-generated manipulated content (deepfake) involving face-swapping AI technology. The police action indicates that the content is considered harmful or unlawful, implying a violation or harm has occurred or is ongoing. The AI system's use directly led to this event. Therefore, this qualifies as an AI Incident due to the realized harm related to rights or social order. It is not merely a potential hazard or complementary information, as the police have intervened and the uploader is detained for investigation.[AI generated]
AI principles
AccountabilityTransparency & explainabilityRespect of human rightsSafetyDemocracy & human autonomy

Industries
Media, social platforms, and marketing

Affected stakeholders
Government

Harm types
Reputational

AI system task:
Content generation


Articles about this incident or hazard