San Francisco Officials Demand Halt to Robotaxi Expansion After AI Vehicle Incidents

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

San Francisco officials have urged California regulators to halt or slow the expansion of Waymo and Cruise robotaxi services after multiple incidents where AI-driven vehicles blocked traffic and interfered with emergency responders, including a case where firefighters had to break a Cruise vehicle’s window to prevent it from driving over fire hoses.[AI generated]

Why's our monitor labelling this an incident or hazard?

Cruise's AVs are AI systems operating autonomously in public streets. The reported incidents, including crashes and interference with firefighting operations, demonstrate direct harm caused by the AI system's malfunction or failure to comply with safety requirements. These harms affect public safety and emergency response, fitting the definition of an AI Incident due to injury or harm to people and disruption of critical infrastructure (emergency services).[AI generated]
AI principles
SafetyRobustness & digital securityAccountabilityTransparency & explainabilityHuman wellbeing

Industries
Mobility and autonomous vehiclesRobots, sensors, and IT hardwareGovernment, security, and defence

Affected stakeholders
WorkersGeneral public

Harm types
Physical (injury)Public interestReputationalEconomic/Property

Business function:
LogisticsMonitoring and quality control

AI system task:
Recognition/object detectionForecasting/predictionGoal-driven organisation

In other databases


Articles about this incident or hazard