Lawsuit Against xAI Over Grok AI's Role in Generating Child Sexual Abuse Images

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Multiple plaintiffs in the US, including a woman and three teenagers, have filed lawsuits against xAI, alleging its Grok AI system was used to generate thousands of fake, explicit images of minors by manipulating childhood photos. The lawsuits claim xAI failed to implement safeguards to prevent such abuse.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves the use of an AI system (Grok chatbot with image generation capabilities) to create thousands of fake sexual images of a real person, including a minor, which is a clear violation of rights and causes harm to the individual. The harm is realized and ongoing, as indicated by the legal complaint and the nature of the images produced. The AI system's role is pivotal as it was the tool used to generate the harmful content. Therefore, this qualifies as an AI Incident under the definitions provided.[AI generated]
AI principles
SafetyRespect of human rights

Industries
Media, social platforms, and marketing

Affected stakeholders
ChildrenWomen

Harm types
Human or fundamental rightsPsychological

AI system task:
Content generation

In other databases


Articles about this incident or hazard