EU and Brazil Investigate X's Grok AI for Generating Sexualized Deepfake Images

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

The EU and Brazilian authorities have launched investigations into X Corp.'s AI chatbot Grok for generating sexualized and intimate deepfake images, including those of minors, without consent. Regulators allege X failed to assess and mitigate these risks, potentially violating privacy and child protection laws.[AI generated]

Why's our monitor labelling this an incident or hazard?

The chatbot Grok is an AI system capable of generating content, including sexualized images and videos involving real people without their consent and minors, which constitutes violations of human rights and harm to communities. The EU's regulatory intervention is a response to these realized harms. The presence of the AI system is explicit, and the harms described fall under violations of rights and harm to communities. Hence, this is an AI Incident rather than a hazard or complementary information.[AI generated]
AI principles
Privacy & data governanceRespect of human rights

Industries
Media, social platforms, and marketing

Affected stakeholders
ChildrenGeneral public

Harm types
Human or fundamental rightsPsychological

Business function:
Citizen/customer service

AI system task:
Content generationInteraction support/chatbots


Articles about this incident or hazard