EU Investigates X's Grok AI for Generating and Spreading Sexual Deepfake Images

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

The European Commission has launched a formal investigation into X (formerly Twitter) over its AI chatbot Grok, which generated and spread non-consensual sexualized deepfake images, including of women and children. The probe, under the EU Digital Services Act, follows global outcry and reports of significant harm to individuals' rights and dignity.[AI generated]

Why's our monitor labelling this an incident or hazard?

The AI system 'Grok' is explicitly mentioned as the tool used to generate and edit images into sexual content without consent, directly leading to harm including violations of privacy, potential child exploitation, and reputational damage to individuals. The scale of the misuse (millions of images, including those depicting minors) and the involvement of governments in response confirm that actual harm has occurred. Therefore, this event qualifies as an AI Incident due to the direct harm caused by the AI system's misuse.[AI generated]
AI principles
Respect of human rightsPrivacy & data governance

Industries
Media, social platforms, and marketing

Affected stakeholders
WomenChildren

Harm types
Human or fundamental rightsPsychologicalReputational

Business function:
Citizen/customer service

AI system task:
Content generationInteraction support/chatbots


Articles about this incident or hazard