Tesla FSD AI Failures Lead to Near-Train Collisions and Unsafe Driving Behavior

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Tesla's Full Self-Driving (FSD) AI system has repeatedly failed to recognize active railroad crossings, nearly causing collisions with trains. Viral videos show users bypassing safety features, increasing crash risks. These incidents have prompted regulatory scrutiny and highlight ongoing safety concerns with Tesla's autonomous driving technology in the United States.[AI generated]

Why's our monitor labelling this an incident or hazard?

The Tesla FSD system is an AI system designed for autonomous driving. The described events involve the AI system's malfunction or failure to correctly interpret railroad crossing signals and the presence of trains, leading to near collisions or actual collisions with trains. This directly endangers human life and safety, fulfilling the criteria for injury or harm to persons. The involvement of regulatory probes further confirms the recognition of these harms. Hence, this is an AI Incident due to realized harm caused by the AI system's malfunction in real-world use.[AI generated]
AI principles
SafetyRobustness & digital security

Industries
Mobility and autonomous vehicles

Affected stakeholders
ConsumersGeneral public

Harm types
Physical (injury)

AI system task:
Recognition/object detectionGoal-driven organisation


Articles about this incident or hazard