AI-Driven Robotaxis Cause Traffic Disruptions and Hit-and-Run Confusion in San Francisco

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Driverless vehicles from Waymo, Cruise, and WeRide in San Francisco have caused numerous incidents, including traffic blockages, confusion in hit-and-run accidents, and disruptions during foggy conditions. These AI-operated cars have led to public safety concerns, regulatory scrutiny, and inconvenience for human drivers and emergency responders.[AI generated]

Why's our monitor labelling this an incident or hazard?

The vehicles are AI systems (self-driving cars using lidar, cameras, radar). The event involved the use of these AI systems encountering environmental challenges (fog), leading to a safety response that caused traffic disruption. This disruption is a form of harm under category (b) "Disruption of the management and operation of critical infrastructure" (traffic management). Although no physical injury or accident occurred, the disruption to traffic is a realized harm caused indirectly by the AI system's operation. Therefore, this qualifies as an AI Incident rather than a hazard or complementary information.[AI generated]
AI principles
SafetyRobustness & digital securityAccountabilityTransparency & explainabilityHuman wellbeing

Industries
Mobility and autonomous vehiclesRobots, sensors, and IT hardwareGovernment, security, and defence

Affected stakeholders
General publicWorkers

Harm types
Public interestReputationalPsychologicalEconomic/Property

Business function:
LogisticsMonitoring and quality controlCompliance and justice

AI system task:
Recognition/object detectionGoal-driven organisationReasoning with knowledge structures/planning


Articles about this incident or hazard