Waymo Robotaxi Malfunction Causes Passenger Distress in Santa Monica

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A Waymo autonomous taxi in Santa Monica, California, malfunctioned by taking an incorrect route and failing to allow human override, leaving passengers distressed and forcing them to exit the vehicle in the street. The incident highlights safety concerns with AI-driven transportation systems.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves an AI system (Waymo's autonomous taxi) whose malfunction (incorrect routing and inability to be overridden by a human) directly led to a potentially hazardous situation for the passengers, including the need to exit the vehicle in the street. This meets the criteria for an AI Incident as it involves harm or risk to persons caused by the AI system's use and malfunction. The article explicitly describes the AI system's behavior and its impact, confirming the AI system's role in the incident.[AI generated]
AI principles
SafetyDemocracy & human autonomy

Industries
Mobility and autonomous vehicles

Affected stakeholders
Consumers

Harm types
Psychological

AI system task:
Recognition/object detectionGoal-driven organisation


Articles about this incident or hazard