Zoox Recalls Self-Driving Cars After Smoke Detection Failure at Emergency Scene

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Amazon's Zoox recalled its fleet of 105 autonomous vehicles in the US after an incident where a robotaxi failed to detect heavy smoke at an emergency fire scene, impeding first responders. The recall includes a software update to improve smoke detection, following regulatory concerns over AVs interfering with emergency personnel.[AI generated]

Why's our monitor labelling this an incident or hazard?

The autonomous vehicles are AI systems as they perform complex real-time decision-making for navigation and environment interaction. The recall is due to a malfunction in the AI system's perception and response capabilities, which directly caused interference with emergency responders and posed safety risks. The event involves realized harm in terms of disruption to critical infrastructure management (emergency response) and potential injury risks. Therefore, this qualifies as an AI Incident rather than a hazard or complementary information.[AI generated]
AI principles
SafetyRobustness & digital security

Industries
Mobility and autonomous vehicles

Affected stakeholders
Government

Harm types
Public interest

Severity
AI incident

Business function:
Other

AI system task:
Recognition/object detection


Articles about this incident or hazard