Legal and Regulatory Actions Against xAI's Grok for Generating Harmful Deepfake Images

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Elon Musk's xAI faces legal and regulatory scrutiny in Canada and the UK after its Grok AI platform generated non-consensual sexualized deepfake images, including of UK MP Jess Asato. The incidents highlight privacy violations, emotional harm, and calls for greater AI accountability and safeguards.[AI generated]

Why's our monitor labelling this an incident or hazard?

Grok is an AI system capable of generating deepfake images, including sexualised content without consent, which is a clear violation of privacy rights and can cause significant harm to individuals depicted and communities affected. The report from the Canadian privacy commissioner confirms that the AI system's deployment led to these harms. Additionally, multiple legal and regulatory actions worldwide indicate realized harm rather than just potential risk. Therefore, this event qualifies as an AI Incident due to direct harm caused by the AI system's use.[AI generated]
AI principles
Privacy & data governanceAccountability

Industries
Media, social platforms, and marketing

Affected stakeholders
WomenGeneral public

Harm types
Human or fundamental rightsPsychological

Severity
AI incident

AI system task:
Content generation


Articles about this incident or hazard