Pony.ai Recalls Autonomous Driving Software After Crash in California

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Pony.ai recalled its autonomous driving software after a driverless test vehicle crashed into a street sign in California, causing property damage. The incident, attributed to a software malfunction, prompted regulatory action from the NHTSA and led to the suspension of Pony.ai’s driverless testing permit.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves an AI system (autonomous driving software) whose malfunction directly caused a crash, which is a harm to property and led to regulatory consequences. The recall and suspension indicate the harm has materialized. Therefore, this qualifies as an AI Incident.[AI generated]
AI principles
SafetyRobustness & digital securityAccountabilityTransparency & explainability

Industries
Mobility and autonomous vehiclesGovernment, security, and defence

Affected stakeholders
Government

Harm types
Economic/PropertyReputational

Business function:
Research and developmentMonitoring and quality controlCompliance and justice

AI system task:
Recognition/object detectionForecasting/predictionReasoning with knowledge structures/planningGoal-driven organisation

In other databases

Articles about this incident or hazard