Tesla AI System Blamed in Fatal South Korea Crash Sparks Trial and Safety Scrutiny

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A 2020 crash in Seoul involving a Tesla Model X, which allegedly accelerated and failed to brake due to possible AI system malfunction, resulted in a fatality and injury. The incident has led to a criminal trial and heightened scrutiny of Tesla’s AI-driven safety features and regulatory oversight in South Korea.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event describes a fatal crash involving a Tesla vehicle, which uses AI systems for autonomous and electronic control functions. The driver's claim that the car accelerated on its own and the failure of electronic doors to open during rescue indicate a malfunction of AI or AI-enabled systems. This malfunction directly led to harm (death of a passenger and injury to the driver). Therefore, this qualifies as an AI Incident because the AI system's malfunction has directly led to harm to persons. The ongoing trial and regulatory scrutiny further confirm the significance of the AI system's role in the incident.[AI generated]
AI principles
SafetyRobustness & digital securityAccountabilityTransparency & explainabilityHuman wellbeing

Industries
Mobility and autonomous vehiclesConsumer productsGovernment, security, and defence

Affected stakeholders
Consumers

Harm types
Physical (death)Physical (injury)ReputationalPublic interest

AI system task:
Recognition/object detectionGoal-driven organisation


Articles about this incident or hazard