X’s AI Grok Faces Privacy Breach and Deepfake Flood

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

The Irish Data Protection Commission suspended X’s processing of EU users’ data after discovering personal posts scraped without consent to train its AI assistant Grok. Meanwhile, Elon Musk’s xAI rolled out Grok-2, an image generator on X lacking effective content filters, enabling users to produce violent, hateful and misleading deepfake images.[AI generated]

Why's our monitor labelling this an incident or hazard?

Grok 2.0 is an AI generative system explicitly mentioned as producing harmful content including violent images, deepfakes, and copyright violations. The article details actual instances of such content being generated and shared, indicating realized harm to communities (through misinformation and violent imagery) and violations of intellectual property rights. The AI system's design and deployment without adequate safeguards have directly led to these harms, qualifying this event as an AI Incident under the OECD framework.[AI generated]
AI principles
Privacy & data governanceRespect of human rightsRobustness & digital securitySafetyTransparency & explainabilityAccountabilityDemocracy & human autonomyHuman wellbeing

Industries
Media, social platforms, and marketingDigital security

Affected stakeholders
ConsumersGeneral public

Harm types
Human or fundamental rightsReputationalPsychologicalPublic interestEconomic/Property

Severity
AI incident

Business function:
ICT management and information securityMonitoring and quality controlCompliance and justiceResearch and development

AI system task:
Interaction support/chatbotsContent generation

In other databases

Articles about this incident or hazard