Waymo Autonomous Vehicle Enters Closed Denver Farmers Market, Raising Safety Concerns

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A Waymo self-driving car in Denver, Colorado, bypassed barricades and entered the South Pearl Street Farmers Market during setup, causing confusion and concern among vendors and bystanders. Although no injuries occurred, the AI system's failure to recognize restricted access highlighted potential safety risks and sparked community backlash.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves an AI system (Waymo's autonomous vehicle) operating in a complex environment (farmers market during setup). While no injury or damage occurred, the vehicle's presence in a restricted area with people around presents a credible risk of harm if the AI system were to malfunction or misinterpret the environment. This fits the definition of an AI Hazard, as the event plausibly could lead to an AI Incident in the future. Since no actual harm occurred, it is not an AI Incident. The event is not merely complementary information or unrelated, as it involves a specific AI system's operation with potential safety implications. It is also not a beneficial use, as the AI system is not deployed solely as a countermeasure to an external harm.[AI generated]
AI principles
SafetyRobustness & digital security

Industries
Mobility and autonomous vehicles

Affected stakeholders
WorkersGeneral public

Harm types
Psychological

Business function:
Other

AI system task:
Recognition/object detectionGoal-driven organisation


Articles about this incident or hazard