Grok Chatbot Leaks Hundreds of Thousands of User Conversations via Search Engines

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

xAI's Grok chatbot exposed over 370,000 user conversations, including sensitive personal data and harmful content, due to a design flaw where shared chat links were automatically indexed by search engines without user consent. This resulted in widespread privacy violations and public access to dangerous AI-generated instructions.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves an AI system (Grok chatbot) whose use and design directly led to the exposure of sensitive personal data and harmful content online, constituting a violation of user privacy and potentially human rights. The exposure of sensitive medical, psychological, and personal information, as well as AI-generated instructions for harmful acts, represents realized harm to individuals and communities. Therefore, this qualifies as an AI Incident due to direct harm caused by the AI system's use and malfunction in protecting user data and content.[AI generated]
AI principles
Privacy & data governanceRespect of human rightsTransparency & explainabilityRobustness & digital securitySafetyAccountability

Industries
Media, social platforms, and marketing

Affected stakeholders
ConsumersGeneral public

Harm types
Human or fundamental rightsReputational

Business function:
Citizen/customer service

AI system task:
Content generationInteraction support/chatbots


Articles about this incident or hazard