Uploader Arrested for AI-Generated Deepfake Video of President Jokowi as Egyptian Queen

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Indonesian police arrested a Twitter user for uploading an AI-generated deepfake video that replaced the face of Egyptian Queen Nefertiti with President Jokowi's. The video went viral, sparking public controversy and accusations of defamation, leading authorities to detain the uploader for further investigation.[AI generated]

Why's our monitor labelling this an incident or hazard?

The video is an AI-generated manipulated content (deepfake) involving face-swapping AI technology. The police action indicates that the content is considered harmful or unlawful, implying a violation or harm has occurred or is ongoing. The AI system's use directly led to this event. Therefore, this qualifies as an AI Incident due to the realized harm related to rights or social order. It is not merely a potential hazard or complementary information, as the police have intervened and the uploader is detained for investigation.[AI generated]
AI principles
AccountabilityTransparency & explainabilityRespect of human rightsSafetyDemocracy & human autonomy

Industries
Media, social platforms, and marketing

Affected stakeholders
Government

Harm types
Reputational

Severity
AI incident

AI system task:
Content generation


Articles about this incident or hazard

Thumbnail Image

Edit Jokowi Berbadan Ratu Mesir, Netizen Sumbar Diringkus Polisi

2023-03-30
Pikiran-Rakyat.com
Why's our monitor labelling this an incident or hazard?
The video is an AI-generated manipulated content (deepfake) involving face-swapping AI technology. The police action indicates that the content is considered harmful or unlawful, implying a violation or harm has occurred or is ongoing. The AI system's use directly led to this event. Therefore, this qualifies as an AI Incident due to the realized harm related to rights or social order. It is not merely a potential hazard or complementary information, as the police have intervened and the uploader is detained for investigation.
Thumbnail Image

Nasib Pria yang Edit Video Ratu Mesir Berwajah Jokowi, Baru Viral Sehari Langsung Masuk Bui - Tribunnewsbogor.com

2023-03-30
Tribunnews Bogor
Why's our monitor labelling this an incident or hazard?
The event describes the use of AI or digital editing to create a manipulated video that caused public uproar and legal consequences. While the AI system's use led to social and legal harm, the harm is reputational and related to content manipulation rather than direct physical injury, infrastructure disruption, or clear legal rights violations as per the definitions. The main focus is on the societal and legal response (arrest and investigation) to the AI-enabled content, making it Complementary Information rather than an Incident or Hazard.
Thumbnail Image

Niatnya Mau Terkenal-Edit Video Ratu Mesir Berwajah Jokowi, Baru Viral Sehari-Bob Langsung Masuk Bui - Wartakotalive.com

2023-03-30
Warta Kota
Why's our monitor labelling this an incident or hazard?
The video is an AI-generated deepfake, which is an AI system application involving face replacement. The harm arises from the use of this AI-generated content to defame or harass a public figure, leading to social controversy and legal consequences. This fits the definition of an AI Incident because the AI system's use directly led to harm related to violations of rights and social harm. The event is not merely a product launch or general news, but a specific incident where AI-generated content caused harm and legal action.
Thumbnail Image

Polda Sumbar Amankan Pemilik Akun Twitter Penyebar Video Jokowi Ratu Nefertoto - Tribunpekanbaru.com

2023-03-30
Tribun Pekanbaru
Why's our monitor labelling this an incident or hazard?
The video showing a manipulated face of President Jokowi is indicative of AI-generated deepfake technology, which is an AI system capable of generating realistic but fake videos. The dissemination of such content can cause harm to communities by spreading misinformation and potentially violating rights related to reputation and dignity. The police intervention indicates the seriousness of the harm caused. Therefore, this event qualifies as an AI Incident because the AI system's use (deepfake generation) has directly led to harm in the form of misinformation and reputational damage.
Thumbnail Image

Pemilik Akun Twitter Penyebar Video Jokowi Ratu Nefertoto Minta Maaf, Ini Videonya - Tribunpekanbaru.com

2023-03-31
Tribun Pekanbaru
Why's our monitor labelling this an incident or hazard?
The event involves the use of an AI system or AI-generated content (a manipulated video) that was spread on social media, leading to social and legal consequences. The video likely involves AI-based deepfake or generative technology to create the altered image of the president. The dissemination of such manipulated content can cause harm to communities by spreading misinformation and potentially damaging reputations, which constitutes harm under the framework. Since the harm (social disruption, misinformation, legal action) has already occurred, this qualifies as an AI Incident.
Thumbnail Image

VIRAL Video Ratu Mesir Berwajah Presiden Jokowi, Pengunggah Ditangkap, Klarifikasi dan Minta Maaf - Tribun-medan.com

2023-03-31
Tribun Medan
Why's our monitor labelling this an incident or hazard?
The video is a deepfake, which is a product of AI systems capable of generating realistic manipulated media. The viral spread of this manipulated content caused social disturbance and led to legal consequences, fulfilling the criteria of an AI Incident due to harm to communities and violation of rights (reputation, dignity). The AI system's use in creating the video directly led to the harm and subsequent incident. Therefore, this event qualifies as an AI Incident.
Thumbnail Image

Polisi Tangkap Uploader Video Ratu Mesir Berwajah Mirip Jokowi

2023-03-30
detik News
Why's our monitor labelling this an incident or hazard?
The video manipulation likely involved AI-based deepfake technology to alter the face in the video, which qualifies as an AI system's use. The event involves the use of AI-generated content that could potentially cause harm such as misinformation, defamation, or political manipulation. Since the uploader was arrested, it indicates that the authorities consider this a violation of law or rights. The event describes a realized harm related to misuse of AI-generated content leading to legal action, thus it qualifies as an AI Incident under violations of applicable law or rights.
Thumbnail Image

4 Fakta Pengunggah Sesali Sebar Video Ratu Mesir Mirip Jokowi

2023-04-02
detik News
Why's our monitor labelling this an incident or hazard?
The event involves an AI system or AI-enabled technology (face editing in video) used to create manipulated content. The uploader's arrest indicates legal consequences, but the article does not describe actual harm caused by the AI system's use, such as injury, rights violations, or community harm. Therefore, it does not meet the criteria for an AI Incident. It also does not describe a plausible future harm scenario or risk, so it is not an AI Hazard. The article primarily reports on the law enforcement response to the misuse of AI-generated content, which fits the definition of Complementary Information as it provides context and updates related to AI misuse and societal response.