Snapchat Removes Speed Filter After AI-Driven Feature Linked to Fatal Crashes

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Snapchat has permanently removed its AI-powered speed filter after it was linked to multiple fatal and near-fatal car crashes. The feature, which displayed users' real-time speed, encouraged reckless driving, especially among teens, leading to lawsuits and widespread criticism over its role in promoting dangerous behavior.[AI generated]

Why's our monitor labelling this an incident or hazard?

The Snapchat speed filter is an AI system feature that infers and displays speed data to users. Its use has indirectly led to harm, specifically fatal car crashes caused by users driving at dangerous speeds to capture high speed readings. The lawsuits and documented incidents show that the AI system's design and use contributed to these harms. Therefore, this event qualifies as an AI Incident due to indirect harm to persons caused by the AI system's use and design.[AI generated]
AI principles
SafetyAccountabilityHuman wellbeing

Industries
Media, social platforms, and marketing

Affected stakeholders
ConsumersGeneral publicChildren

Harm types
Physical (death)Physical (injury)Reputational

Business function:
Other

AI system task:
Other


Articles about this incident or hazard