Tesla FSD Misuse Leads to Police Injury in California

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A Tesla driver in California activated the Full Self-Driving (FSD) AI system and fell asleep, resulting in a collision with a parked police car. Two police officers were seriously injured. The incident highlights the risks of misusing AI-assisted driving systems that require active supervision.[AI generated]

Why's our monitor labelling this an incident or hazard?

The Tesla FSD system is an AI system designed to assist driving but requires active driver supervision. The driver's decision to sleep while the system was engaged constitutes misuse or failure to comply with operational requirements. The crash caused serious injury to two police officers, fulfilling the harm criteria. Therefore, this is an AI Incident due to direct harm caused by the use and misuse of an AI system.[AI generated]
AI principles
SafetyAccountability

Industries
Mobility and autonomous vehicles

Affected stakeholders
Workers

Harm types
Physical (injury)

AI system task:
Recognition/object detectionReasoning with knowledge structures/planning

In other databases


Articles about this incident or hazard