Gmail AI Spam Filter Malfunction Disrupts Global Email Management

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A malfunction in Gmail's AI-powered spam and email classification system caused widespread misclassification, with spam flooding users' primary inboxes and legitimate emails being mislabeled or delayed. The incident disrupted email management, raised privacy and security concerns, and affected millions of users globally before Google resolved the issue.[AI generated]

Why's our monitor labelling this an incident or hazard?

Gmail's sorting system uses AI to classify and organize emails automatically. The malfunction directly led to harm by disrupting users' access to critical services due to delayed two-factor authentication codes, which is a harm to users' access and security (harm to persons). Since the AI system's malfunction caused this disruption and harm, this qualifies as an AI Incident. The event involves an AI system malfunction causing direct harm, not just a potential risk or complementary information.[AI generated]
AI principles
Robustness & digital securityPrivacy & data governance

Industries
Digital securityConsumer services

Affected stakeholders
Consumers

Harm types
Human or fundamental rights

Business function:
ICT management and information security

AI system task:
Event/anomaly detection


Articles about this incident or hazard