Tesla Autopilot Misuse: Driver Filmed Asleep on California Freeway

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A woman was filmed apparently asleep at the wheel of her Tesla on a California freeway, relying on the vehicle's autopilot system for at least 15 minutes. Bystanders attempted to wake her and called police, highlighting the dangers of overreliance and misuse of Tesla's AI-assisted driving technology.[AI generated]

Why's our monitor labelling this an incident or hazard?

The Tesla autopilot system is an AI system involved in the event. The driver was apparently asleep while the AI system was controlling the vehicle, which is a misuse of the AI system and a failure to comply with safety guidelines. This created a direct risk of harm to the driver and other road users, fulfilling the criteria for injury or harm to persons. The incident is not merely a potential hazard but an actual event where the AI system's use contributed to a dangerous situation. Hence, it is classified as an AI Incident.[AI generated]
AI principles
SafetyAccountabilityTransparency & explainabilityRobustness & digital securityDemocracy & human autonomy

Industries
Mobility and autonomous vehicles

Affected stakeholders
ConsumersGeneral public

Harm types
Other

AI system task:
Recognition/object detectionForecasting/predictionGoal-driven organisation


Articles about this incident or hazard