
The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
A Waymo self-driving car in Denver, Colorado, bypassed barricades and entered the South Pearl Street Farmers Market during setup, causing confusion and concern among vendors and bystanders. Although no injuries occurred, the AI system's failure to recognize restricted access highlighted potential safety risks and sparked community backlash.[AI generated]
Why's our monitor labelling this an incident or hazard?
The event involves an AI system (Waymo's autonomous vehicle) operating in a complex environment (farmers market during setup). While no injury or damage occurred, the vehicle's presence in a restricted area with people around presents a credible risk of harm if the AI system were to malfunction or misinterpret the environment. This fits the definition of an AI Hazard, as the event plausibly could lead to an AI Incident in the future. Since no actual harm occurred, it is not an AI Incident. The event is not merely complementary information or unrelated, as it involves a specific AI system's operation with potential safety implications. It is also not a beneficial use, as the AI system is not deployed solely as a countermeasure to an external harm.[AI generated]