
The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
Waymo and Cruise self-driving cars in San Francisco have repeatedly impeded emergency vehicles, run over fire hoses, and malfunctioned, causing safety hazards and disruptions. Additionally, police have begun using robotaxi video footage for investigations, raising significant privacy and human rights concerns over the use and potential misuse of AI-collected data.[AI generated]
Why's our monitor labelling this an incident or hazard?
The vehicles involved are AI systems (self-driving cars) whose malfunction or inadequate performance in real-time decision-making has directly caused disruption to emergency response operations, which qualifies as harm to critical infrastructure management and operation. The incidents have occurred multiple times (66 times this year), indicating realized harm rather than potential harm. Therefore, this qualifies as an AI Incident due to the direct link between AI system malfunction/use and harm to emergency services.[AI generated]