Pony.ai Recalls Autonomous Driving Software After Crash in California

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Pony.ai recalled its autonomous driving software after a driverless test vehicle crashed into a street sign in California, causing property damage. The incident, attributed to a software malfunction, prompted regulatory action from the NHTSA and led to the suspension of Pony.ai’s driverless testing permit.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves an AI system (autonomous driving software) whose malfunction directly caused a crash, which is a harm to property and led to regulatory consequences. The recall and suspension indicate the harm has materialized. Therefore, this qualifies as an AI Incident.[AI generated]
AI principles
SafetyRobustness & digital securityAccountabilityTransparency & explainability

Industries
Mobility and autonomous vehiclesGovernment, security, and defence

Affected stakeholders
Government

Harm types
Economic/PropertyReputational

Severity
AI incident

Business function:
Research and developmentMonitoring and quality controlCompliance and justice

AI system task:
Recognition/object detectionForecasting/predictionReasoning with knowledge structures/planningGoal-driven organisation

In other databases

Articles about this incident or hazard

Thumbnail Image

Startup Pony.ai agrees to automated driving system software recall

2022-03-08
Yahoo News
Why's our monitor labelling this an incident or hazard?
The event involves an AI system (autonomous driving software) whose malfunction directly caused a crash, which is a harm to property and led to regulatory consequences. The recall and suspension indicate the harm has materialized. Therefore, this qualifies as an AI Incident.
Thumbnail Image

Robotaxi start-up Pony.ai valued at $8.5 billion after fresh funding

2022-03-07
CNBC
Why's our monitor labelling this an incident or hazard?
The article describes an AI system (autonomous driving technology) and its development and testing. However, it does not report a new AI Incident or AI Hazard. The past incident is mentioned as background, and the main focus is on funding and future deployment plans. There is no direct or indirect harm currently occurring or a specific plausible future harm detailed beyond general industry risks. Therefore, this is best classified as Complementary Information, providing context on the AI ecosystem and company developments.
Thumbnail Image

Startup Pony.ai agrees to automated driving software recall - ET Auto

2022-03-08
ETAuto.com
Why's our monitor labelling this an incident or hazard?
The event involves an AI system explicitly described as an automated driving system software used in autonomous vehicles. The software malfunction led to a crash, which is a direct harm to property and a safety risk to people, fulfilling the criteria for an AI Incident. The recall and regulatory response further confirm the recognition of harm caused by the AI system's malfunction. Although no injuries occurred, the incident still constitutes harm under the framework (harm to property and potential risk to health).
Thumbnail Image

Autonomous Driving Startup Pony.ai Valued At $8.5 Billion After Series D Funding

2022-03-09
Forbes
Why's our monitor labelling this an incident or hazard?
The article mentions an AI system (autonomous driving software) and a past incident (a crash leading to a recall and license revocation), which involved harm and regulatory action. However, the main focus is on the funding round and company valuation, with the recall and crash described as background context. There is no new harm reported, nor a detailed analysis of the incident's consequences or ongoing risk. Therefore, this article serves primarily as complementary information providing context and updates about the company and its AI system, rather than reporting a new AI Incident or AI Hazard.
Thumbnail Image

Pony.ai to issue recall of autonomous driving software

2022-03-08
Yahoo! Finance
Why's our monitor labelling this an incident or hazard?
The event explicitly involves an AI system (autonomous driving software) whose malfunction directly caused a crash resulting in property damage. The recall and regulatory suspension indicate recognition of a safety defect in the AI system. Although no injuries occurred, the harm to property and the disruption of vehicle operation meet the criteria for an AI Incident. Therefore, this event qualifies as an AI Incident due to the direct link between the AI system malfunction and realized harm.
Thumbnail Image

Startup Pony.ai agrees to automated driving software recall

2022-03-08
CNA
Why's our monitor labelling this an incident or hazard?
The event involves an AI system explicitly described as an autonomous driving system. The crash was caused by a malfunction in the AI software, which directly led to property damage (collision with a street sign) and regulatory consequences (recall and suspension of testing permit). This fits the definition of an AI Incident because the AI system's malfunction directly led to harm (property damage) and disruption (suspension of testing permit). The recall and software update are responses to this incident but do not change the classification of the original event as an AI Incident.
Thumbnail Image

Pony.ai to Recall its Autonomous Driving System Due to Crashes, NHTSA Advices Company

2022-03-09
Tech Times
Why's our monitor labelling this an incident or hazard?
The autonomous driving system is an AI system involved in real-time vehicle control. The reported crashes caused by the system constitute direct harm to people, fulfilling the criteria for an AI Incident. The recall and cooperation with NHTSA are responses to this harm. Since harm has occurred and is linked to the AI system's malfunction, this event is classified as an AI Incident rather than a hazard or complementary information.
Thumbnail Image

Robotaxi Start-Up Pony.ai Valued at $8.5 Billion After Fresh Funding

2022-03-07
NBC New York
Why's our monitor labelling this an incident or hazard?
The article describes an AI system (autonomous driving technology) in development and use, including a recent incident where a Pony.ai vehicle crashed, leading to a suspension of its testing permit. However, the crash is mentioned as a past event with no explicit mention of injury or harm resulting from it. The article primarily focuses on funding, valuation, and future plans rather than detailing any realized harm or direct consequences from the AI system's malfunction or use. Therefore, it does not describe a new AI Incident or AI Hazard. It provides complementary information about the company's progress, challenges, and the broader autonomous vehicle ecosystem, which helps understand the AI landscape and regulatory environment.
Thumbnail Image

Driverless car first: Chinese company recalls faulty AI

2022-03-10
TheRegister.com
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions an AI system (driverless car software) that malfunctioned, causing an accident (damaging street signs) and leading to a regulatory recall due to safety concerns. This constitutes direct harm or risk to public safety (harm to persons and property). The recall is a response to an incident involving the AI system's malfunction, fitting the definition of an AI Incident where the AI system's malfunction has directly or indirectly led to harm or safety risks. Therefore, this event is classified as an AI Incident.
Thumbnail Image

Pony.ai agrees to recall 3 of its autonomous vehicles - The Robot Report

2022-03-08
The Robot Report
Why's our monitor labelling this an incident or hazard?
The event involves an AI system (autonomous driving software) whose malfunction directly led to a crash, causing harm to property. Although no injuries occurred, the software defect caused a tangible incident requiring a recall. This fits the definition of an AI Incident because the AI system's malfunction directly led to harm (property damage) and regulatory action. The recall and software update are responses to the incident but do not change the classification of the original event as an AI Incident.
Thumbnail Image

Pony.ai to Issue Autonomous Driving Recall in U.S.

2022-03-09
Pandaily
Why's our monitor labelling this an incident or hazard?
The event involves an AI system explicitly described as autonomous driving software. The software malfunction directly caused a collision, resulting in harm to property (vehicle damage and street sign). Although no injuries occurred, the damage qualifies as harm under the AI Incident definition (harm to property). The recall and regulatory response confirm the AI system's role in the incident. Therefore, this event meets the criteria for an AI Incident due to the realized harm caused by the AI system's malfunction.
Thumbnail Image

U.S. agency to review if Pony.ai complied with crash reporting order

2022-03-29
Yahoo News
Why's our monitor labelling this an incident or hazard?
The autonomous driving system is an AI system as it performs complex real-time decision-making for vehicle navigation. The crash, caused by the AI system's malfunction (false positive geolocation mismatch leading to shutdown and subsequent collision), directly resulted in property damage and regulatory scrutiny. The event meets the criteria for an AI Incident because the AI system's malfunction directly led to harm (property damage) and regulatory consequences. No plausible future harm is the main focus; the harm has already occurred, so it is not merely a hazard or complementary information.
Thumbnail Image

US investigating autonomous vehicle company's crash report

2022-03-28
Market Beat
Why's our monitor labelling this an incident or hazard?
The autonomous vehicle system is an AI system that malfunctioned, causing a crash. This is a direct harm to property (the median road sign) and a safety incident involving AI. The event meets the criteria for an AI Incident because the AI system's malfunction directly led to harm (property damage). The investigation into reporting timeliness is complementary but does not negate the incident classification. Therefore, this is an AI Incident.
Thumbnail Image

US investigating autonomous vehicle company's crash report

2022-03-30
Market Beat
Why's our monitor labelling this an incident or hazard?
The autonomous vehicle system is an AI system involved in the crash due to a software error, which is a malfunction. The crash is a direct consequence of the AI system's malfunction. Although no injuries or significant property damage occurred, the event still constitutes harm to property (the vehicle and road sign) and potential safety risks. The investigation into reporting compliance is a governance response and does not negate the incident classification. Therefore, this event is best classified as an AI Incident.
Thumbnail Image

U.S. Agency To Review If Pony.ai Complied With Crash Reporting Order

2022-03-31
carandbike
Why's our monitor labelling this an incident or hazard?
The event describes a crash caused by an autonomous driving AI system, which is an AI system by definition. The crash caused physical harm to property (a street sign) and led to regulatory consequences, fulfilling the criteria for an AI Incident. The AI system's malfunction or failure to operate safely directly led to the incident. Although no personal injury occurred, harm to property and disruption of regulatory compliance are sufficient for classification as an AI Incident. The event is not merely a potential hazard or complementary information but a realized incident involving AI.
Thumbnail Image

NHTSA plans to review if Pony.ai complied with crash reporting order

2022-03-29
Automotive News
Why's our monitor labelling this an incident or hazard?
Pony.ai's autonomous driving system is an AI system involved in a crash, which constitutes harm (a) injury or harm to persons or groups, or at least a safety incident. The recall indicates a malfunction or failure in the AI system. The NHTSA's review of compliance with reporting requirements is a governance response to this incident. Since the crash and recall have already occurred, this is an AI Incident involving the use and malfunction of an AI system leading to harm or potential harm. The review itself is complementary information but the core event is the crash and recall, which is an AI Incident.
Thumbnail Image

US investigating autonomous vehicle company's crash report

2022-03-28
Seattle Pi
Why's our monitor labelling this an incident or hazard?
An AI system (autonomous vehicle software) malfunctioned causing a crash, but no harm to persons or property occurred. The event concerns regulatory compliance and data collection for future regulation, with no direct or indirect harm reported. Therefore, this is an AI Hazard because the software error could plausibly lead to harm in other circumstances, but here no harm occurred. The investigation and regulatory context indicate potential future risk rather than realized harm.
Thumbnail Image

US investigating autonomous vehicle company's crash report | Federal News Network

2022-03-28
Federal News Network
Why's our monitor labelling this an incident or hazard?
The crash was caused by a software error in an autonomous vehicle system, which is an AI system. The incident resulted in a collision with a median road sign, indicating harm to property. The investigation focuses on the company's compliance with reporting regulations, but the harm from the AI system's malfunction has already occurred. Hence, this is an AI Incident as the AI system's malfunction directly led to harm.
Thumbnail Image

US investigating autonomous vehicle company's crash report

2022-03-28
KOB 4
Why's our monitor labelling this an incident or hazard?
The article describes a crash involving an autonomous vehicle, which is an AI system, and the subsequent investigation into whether the company complied with reporting requirements. While the crash itself is an incident involving an AI system, the article does not specify any actual harm (injury, property damage, or rights violations) resulting from the crash. The focus is on regulatory compliance and data collection for future regulations, which is a governance and oversight activity. Therefore, this event is best classified as Complementary Information, as it provides context on regulatory responses and oversight related to AI systems in autonomous vehicles, without reporting a new AI Incident or AI Hazard.
Thumbnail Image

US investigating autonomous vehicle company's crash report | News Channel 3-12

2022-03-28
NewsChannel 3-12
Why's our monitor labelling this an incident or hazard?
The autonomous vehicle system is an AI system whose software error caused a crash, resulting in harm to property (the road sign). Although no injuries occurred, the crash is a realized harm linked directly to the AI system's malfunction. Therefore, this qualifies as an AI Incident due to harm to property caused by the AI system's malfunction. The investigation into reporting timeliness is complementary but the core event is the crash caused by the AI system.
Thumbnail Image

US investigating autonomous vehicle company's crash report | News Channel 3-12

2022-03-28
NewsChannel 3-12
Why's our monitor labelling this an incident or hazard?
The autonomous vehicle system is an AI system, and its software error directly caused a crash, which is harm to property and a safety incident. The investigation by the National Highway Traffic Safety Administration relates to compliance with reporting requirements but does not negate the fact that the AI system's malfunction led to harm. Therefore, this event is classified as an AI Incident.
Thumbnail Image

U.S. Agency to Review Pony.ai's Reporting of Autonomous Driving Accidents

2022-03-30
Pandaily
Why's our monitor labelling this an incident or hazard?
The autonomous driving system is an AI system as it performs complex real-time decision-making for vehicle navigation without human intervention. The crash incident, although causing only slight vehicle damage and no injuries, is a direct harm linked to the AI system's malfunction or failure. The regulatory recall and investigation further confirm the AI system's role in the incident. Hence, this event meets the criteria for an AI Incident as it involves harm caused by the use and malfunction of an AI system.
Thumbnail Image

US investigating autonomous vehicle company's crash report

2022-03-28
The Bakersfield Californian
Why's our monitor labelling this an incident or hazard?
The crash was caused by a software error in the autonomous vehicle system, which is an AI system. The crash resulted in damage to a median road sign, which is harm to property. Although no injuries were reported, the AI system's malfunction directly led to this harm. The investigation concerns the timeliness and accuracy of crash reporting, but the core event is the AI system's failure causing a crash. This fits the definition of an AI Incident as the AI system's malfunction directly led to harm (property damage).
Thumbnail Image

US investigating autonomous vehicle company's crash report

2022-03-28
Siliconeer
Why's our monitor labelling this an incident or hazard?
The crash was caused by a software error in an autonomous vehicle system, which is an AI system malfunction. Although no injuries or property damage occurred, the event reveals a potential risk of harm from AI system failures. The delayed reporting raises concerns about safety oversight and compliance, which could plausibly lead to harm in future incidents. Therefore, this event is best classified as an AI Hazard rather than an AI Incident, as the harm is potential rather than realized.
Thumbnail Image

美公路管理局审查小马智行是否遵守无人车事故报告要求

2022-03-29
凤凰网(凤凰新媒体)
Why's our monitor labelling this an incident or hazard?
The autonomous driving system is an AI system involved in a crash incident causing harm or risk of harm. The NHTSA's review of compliance with accident reporting requirements and the recall of software versions indicate the AI system's malfunction or failure to meet safety standards. The event describes a realized harm (the crash) and regulatory response, fitting the definition of an AI Incident rather than a hazard or complementary information. The AI system's malfunction and use directly led to the incident, fulfilling the criteria for an AI Incident.
Thumbnail Image

美国防部新项目曝光:AI决定军事行动?

2022-03-31
凤凰网(凤凰新媒体)
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the development and future deployment of an AI system designed to assist or make complex military decisions, including who receives aid in emergencies. This involves AI system development and intended use in high-stakes scenarios where errors or misuse could cause injury or death, constituting harm under the framework. Since the system is still in development and not yet operational, no actual harm has occurred, but the plausible future harm is significant. Hence, this qualifies as an AI Hazard rather than an AI Incident.