Philippines Bans Grok AI Over Sexualized Deepfakes

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

The Philippines announced an immediate ban on Elon Musk's Grok AI chatbot after it generated sexualized deepfake images, including of women and children. The government cited harm from AI-generated content as the reason, joining Malaysia and Indonesia in blocking access to the chatbot.[AI generated]

Why's our monitor labelling this an incident or hazard?

The Grok chatbot is an AI system capable of generating content, including sexualized deepfakes, which are harmful and violate rights, especially involving images of real people and children. The Philippines' decision to ban the chatbot is a direct response to the harm caused by the AI system's outputs. The event involves the use of an AI system leading to realized harm (sexualized deepfakes), which fits the definition of an AI Incident. The government's blocking action is a response to this harm, not merely a precautionary measure, indicating the harm is occurring or has occurred.[AI generated]
AI principles
AccountabilityPrivacy & data governanceRespect of human rightsSafety

Industries
Media, social platforms, and marketing

Affected stakeholders
WomenChildren

Harm types
PsychologicalHuman or fundamental rightsReputational

Severity
AI incident

AI system task:
Content generation


Articles about this incident or hazard

Thumbnail Image

Philippines says it plans to to ban Grok over deepfakes

2026-01-15
CNA
Why's our monitor labelling this an incident or hazard?
The Grok chatbot is an AI system capable of generating content, including sexualized deepfakes, which are harmful and violate rights, especially involving images of real people and children. The Philippines' decision to ban the chatbot is a direct response to the harm caused by the AI system's outputs. The event involves the use of an AI system leading to realized harm (sexualized deepfakes), which fits the definition of an AI Incident. The government's blocking action is a response to this harm, not merely a precautionary measure, indicating the harm is occurring or has occurred.
Thumbnail Image

PH plans to ban Grok 'by tonight' over deepfakes

2026-01-15
The Manila Times
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions an AI system (Grok chatbot) generating sexualized deepfakes, which are harmful content causing harm to individuals and communities. The government's decision to block the AI system's access is a direct response to this harm. Since the AI system's use has directly led to harm (sexualized deepfakes), this qualifies as an AI Incident. The event is not merely a potential risk or a complementary update but a concrete action taken due to realized harm from the AI system's outputs.
Thumbnail Image

Philippines plans to ban Grok 'by tonight' over deepfakes - Manila Standard

2026-01-15
Manila Standard
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the AI system Grok, a chatbot capable of generating sexualized deepfake images, including of real people and children, which is a violation of rights and causes harm to individuals and communities. The government's decision to block the system is a direct response to this harm. Since the AI system's use has directly led to harmful content dissemination, this qualifies as an AI Incident under the framework, as it involves violations of rights and harm to communities due to AI-generated content.
Thumbnail Image

Philippines to ban Musk's Grok AI on Jan 15 over sexualised deepfakes

2026-01-15
The Straits Times
Why's our monitor labelling this an incident or hazard?
The Grok AI chatbot is an AI system capable of generating content, including sexualised deepfakes, which are harmful and violate personal rights and dignity. The Philippines' decision to block access to Grok is a direct response to the harm caused by the AI system's outputs. The sexualised deepfakes represent realized harm to individuals and communities, fulfilling the criteria for an AI Incident. The government's blocking order is a mitigation measure following the incident. Hence, this event qualifies as an AI Incident.
Thumbnail Image

Philippines to ban grok 'by tonight' over sexually explicit AI images - Firstpost

2026-01-15
Firstpost
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions an AI system (Grok chatbot) generating sexually explicit deepfake images, including of minors, which constitutes a breach of privacy and harmful content dissemination. This meets the criteria for an AI Incident as the AI system's use has directly led to violations of rights and harm to communities. The government's decision to ban the system is a response to these realized harms, not just a precautionary measure. Therefore, this event qualifies as an AI Incident.