Tesla's Full Self-Driving System Fails to Stop at Red Lights

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Tesla owners report their vehicles running red lights due to the Full Self-Driving (FSD) system, raising safety concerns. Despite Tesla's claims of near autonomy, the FSD system is still in development. Users shared experiences and videos online, highlighting the system's dangerous shortcomings and loss of trust among drivers.[AI generated]

Why's our monitor labelling this an incident or hazard?

Owners have documented multiple instances of Teslas passing through red signals due to FSD misbehavior—an AI malfunction directly endangering road users. The issue is ongoing, has already contributed to crashes (including fatalities under investigation), and stems from the system’s development and deployment. This constitutes an AI Incident.[AI generated]
AI principles
SafetyRobustness & digital securityAccountabilityTransparency & explainabilityHuman wellbeingDemocracy & human autonomy

Industries
Mobility and autonomous vehiclesConsumer productsRobots, sensors, and IT hardware

Affected stakeholders
ConsumersGeneral public

Harm types
Physical (injury)Physical (death)Economic/PropertyReputationalPsychologicalPublic interest

Business function:
Research and developmentMonitoring and quality controlCompliance and justice

AI system task:
Recognition/object detectionForecasting/predictionGoal-driven organisation


Articles about this incident or hazard