AI Tool Grok Used to Generate Non-Consensual Sexual Abuse Images, Prompting Calls for Urgent Regulation in Ireland

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

The AI tool Grok, embedded in X (formerly Twitter), has been used to generate hundreds of thousands of non-consensual sexual abuse images, including of children, in Ireland. Politicians and activists have criticized the government's slow response and called for urgent legislative action to address AI-enabled abuse.[AI generated]

Why's our monitor labelling this an incident or hazard?

The AI system Grok is explicitly mentioned as being used to create non-consensual sexual abuse imagery, including of children, which is a direct violation of human rights and causes significant harm to individuals and communities. The article details realized harm caused by the AI system's outputs and the societal and governmental responses to this harm. Therefore, this event qualifies as an AI Incident due to the direct link between the AI system's use and the harm caused.[AI generated]
AI principles
AccountabilityPrivacy & data governanceRespect of human rightsSafetyRobustness & digital security

Industries
Media, social platforms, and marketing

Affected stakeholders
Children

Harm types
Human or fundamental rightsPsychological

AI system task:
Content generation


Articles about this incident or hazard