
The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
Waymo's autonomous vehicle AI detected a firearm violation involving two minors in San Francisco, pulled over, and alerted police. Officers found a loaded AR-style "ghost gun" and other contraband, arresting the juveniles. The AI system's intervention directly led to the discovery and prevention of potential harm.[AI generated]
Why's our monitor labelling this an incident or hazard?
The autonomous vehicle is an AI system as it operates driverlessly and makes decisions such as pulling over based on detected violations. The AI system's use led directly to the discovery of illegal weapons and the arrest of the juveniles, which involves law enforcement and public safety. This constitutes an AI Incident because the AI system's use directly led to harm prevention and legal enforcement actions related to illegal firearm possession, which is a violation of law and a public safety concern. The AI system's role was pivotal in detecting the violation and initiating the stop, thus directly contributing to the incident.[AI generated]