Tesla Autopilot Nearly Causes Collision with Oncoming Train in Denver

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A Tesla Model 3 using the Full Self-Driving (FSD) Autopilot system in Denver nearly turned into the path of an oncoming train, despite the AI detecting the train on its display. The driver had to intervene to prevent a collision, highlighting a critical malfunction and safety risk in Tesla's AI driving system.[AI generated]

Why's our monitor labelling this an incident or hazard?

The Tesla Autopilot system is an AI system providing autonomous driving assistance. The event involves the AI system's malfunction or failure to act appropriately, leading directly to a hazardous situation with potential injury or harm to people (harm category a). Although no actual injury occurred due to driver intervention, the near-miss and multiple dangerous maneuvers demonstrate a clear AI Incident as the AI system's use directly led to a significant safety risk. The report of many crashes involving Tesla's Level 2 systems further supports the classification as an AI Incident rather than a mere hazard or complementary information.[AI generated]
AI principles
SafetyRobustness & digital securityTransparency & explainabilityAccountabilityDemocracy & human autonomy

Industries
Mobility and autonomous vehicles

Affected stakeholders
Consumers

Harm types
Physical (death)Physical (injury)PsychologicalReputationalEconomic/Property

Business function:
Other

AI system task:
Recognition/object detectionGoal-driven organisationReasoning with knowledge structures/planning


Articles about this incident or hazard