Canadian Watchdog Finds X's Grok AI Tool Violated Privacy Laws with Sexualized Deepfakes

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Canada's privacy commissioner found that xAI's Grok AI image generation tool, deployed on X, enabled users to create millions of non-consensual sexualized deepfake images, including thousands involving children. The investigation concluded that inadequate safeguards led to significant privacy violations and harm, prompting regulatory scrutiny and mandated corrective actions.[AI generated]

Why's our monitor labelling this an incident or hazard?

Grok is an AI system generating deepfake images, including sexualized and nonconsensual content involving adults and children. The sharing of these images constitutes a violation of privacy laws and potentially human rights. The article describes ongoing harm, regulatory rulings, and legal investigations, confirming that the AI system's use has directly led to significant harm. The involvement of AI in producing harmful content and the legal consequences align with the definition of an AI Incident.[AI generated]
AI principles
Privacy & data governanceRespect of human rights

Industries
Media, social platforms, and marketing

Affected stakeholders
General publicChildren

Harm types
Human or fundamental rightsPsychological

AI system task:
Content generation


Articles about this incident or hazard