Tesla Autopilot Misuse and Safety Concerns Lead to Legal Action and Fatalities

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A Canadian man was charged for sleeping while his Tesla, using Autopilot, drove at high speed, highlighting misuse of the AI system. Studies and crash investigations reveal that Tesla's Autopilot has contributed to driver distraction and multiple fatal accidents, raising ongoing safety concerns about the system's deployment.[AI generated]

Why's our monitor labelling this an incident or hazard?

Tesla Autopilot is an AI system designed for semi-autonomous driving. The study and multiple crash investigations show that the system's use has directly or indirectly led to harm, including fatal accidents, due to driver distraction and overreliance on the system. The AI system's malfunction or limitations in ensuring driver engagement have contributed to these harms. This fits the definition of an AI Incident as the AI system's use has led to injury or harm to persons. The article also references regulatory scrutiny and calls for improved safety measures, but the primary focus is on realized harm, not just potential risk or responses, so it is not merely Complementary Information or an AI Hazard.[AI generated]
AI principles
SafetyRobustness & digital securityAccountabilityTransparency & explainabilityDemocracy & human autonomy

Industries
Mobility and autonomous vehicles

Affected stakeholders
ConsumersGeneral public

Harm types
Physical (death)Physical (injury)

AI system task:
Recognition/object detectionGoal-driven organisation


Articles about this incident or hazard