California Revokes Pony.ai's Autonomous Vehicle Testing Permits Over Safety Concerns

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

California's DMV revoked all of Pony.ai's autonomous vehicle testing permits after discovering safety violations in the driving records of its safety drivers. The regulatory action follows a previous accident involving Pony.ai's AI system, highlighting ongoing safety and compliance concerns with autonomous vehicle testing.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves an AI system (autonomous vehicles) whose use is directly linked to safety concerns due to the safety drivers' poor driving records. The revocation of the testing license is a regulatory response to prevent potential harm to people, indicating that the AI system's use has indirectly led to a risk of harm. Since the license revocation is due to safety violations that could lead to injury or harm if testing continued, this qualifies as an AI Incident under the definition of harm to health or safety of persons resulting from the use of an AI system.[AI generated]
AI principles
SafetyAccountabilityTransparency & explainabilityRobustness & digital security

Industries
Mobility and autonomous vehiclesRobots, sensors, and IT hardwareGovernment, security, and defence

Harm types
Physical (injury)Economic/PropertyReputationalPublic interest

Severity
AI incident

Business function:
Research and developmentMonitoring and quality controlCompliance and justice

AI system task:
Recognition/object detectionForecasting/predictionGoal-driven organisationReasoning with knowledge structures/planning


Articles about this incident or hazard

Thumbnail Image

Pony.ai's license to test autonomous vehicles with safety drivers in California is revoked

2022-05-26
The Verge
Why's our monitor labelling this an incident or hazard?
The event involves an AI system (autonomous vehicles) whose use is directly linked to safety concerns due to the safety drivers' poor driving records. The revocation of the testing license is a regulatory response to prevent potential harm to people, indicating that the AI system's use has indirectly led to a risk of harm. Since the license revocation is due to safety violations that could lead to injury or harm if testing continued, this qualifies as an AI Incident under the definition of harm to health or safety of persons resulting from the use of an AI system.
Thumbnail Image

Pony.ai Loses Autonomous Driving Test Permit in California

2022-05-26
tmtpost.com
Why's our monitor labelling this an incident or hazard?
The event explicitly involves an AI system—Pony.ai's autonomous driving software—and its use in real-world testing. The revocation of the permit is due to safety concerns linked to the AI system's malfunction (software causing a crash) and regulatory actions (recall due to safety issues). These issues have directly led to harm or risk of harm to public safety, fulfilling the criteria for an AI Incident. The crash and software safety issues indicate realized harm or significant risk, not just potential future harm. Therefore, this is classified as an AI Incident.
Thumbnail Image

Pony.ai loses permit to test autonomous vehicles with driver in California

2022-05-24
TechCrunch
Why's our monitor labelling this an incident or hazard?
The event involves an AI system (autonomous vehicle technology) whose use and malfunction (software default suspected in a collision) have led to regulatory revocation of testing permits due to safety risks. The failure to monitor safety drivers' records contributed to the risk, and the prior collision suggests realized harm or near harm. Therefore, this qualifies as an AI Incident because the AI system's use and malfunction have directly led to harm or risk to public safety, triggering permit revocation.
Thumbnail Image

Self-Driving Car Startup Loses License in California

2022-05-26
TheStreet
Why's our monitor labelling this an incident or hazard?
The article describes an autonomous vehicle startup losing its testing permit due to safety concerns and violations related to safety drivers, following a prior crash involving their self-driving car. The AI system (autonomous driving technology) is central to the event. However, no direct harm or injury caused by the AI system is reported in this event. The revocation of the permit is a preventive measure reflecting the plausible risk of harm from the AI system's operation. Thus, it fits the definition of an AI Hazard, where the AI system's use could plausibly lead to an AI Incident (harm). It is not an AI Incident because no harm has occurred in this specific event, nor is it Complementary Information or Unrelated.
Thumbnail Image

Pony.ai Lost Its Testing Permit Because Of Driving Violations By Its Safety Drivers

2022-05-27
Jalopnik
Why's our monitor labelling this an incident or hazard?
The article involves an AI system (autonomous vehicles) and its use (testing with safety drivers). The revocation of the testing permit is due to safety drivers' driving violations, which is a human factor issue rather than a direct or indirect harm caused by the AI system itself. No injury, property damage, rights violation, or other harm caused by the AI system is reported. The event is about regulatory compliance and operational status, not about harm or plausible harm from the AI system. Hence, it is best classified as Complementary Information, providing context on the AI ecosystem and regulatory environment.
Thumbnail Image

What's going on with self-driving cars right now?

2022-05-28
Popular Science
Why's our monitor labelling this an incident or hazard?
The article involves AI systems (autonomous driving AI) and describes a regulatory setback due to safety concerns linked to the operation of these systems and their human safety drivers. While there was a collision mentioned, no harm or injury is reported. The loss of permit and license suspension are responses to safety risks, indicating plausible risk but no confirmed incident of harm. Therefore, this event is best classified as an AI Hazard, as the AI systems' use could plausibly lead to harm, and regulatory authorities have acted to mitigate these risks. The article also provides broader context on industry developments but does not focus on a specific incident causing realized harm.
Thumbnail Image

Pony.ai's permit to test autonomous vehicles revoked in California

2022-05-26
UPI
Why's our monitor labelling this an incident or hazard?
The event concerns the use and regulation of an AI system (autonomous vehicles) and references a prior incident involving a software defect and vehicle recall. The current event is about permit revocation due to safety driver record violations, which is a governance and compliance issue rather than a new AI Incident or Hazard. There is no direct or indirect harm occurring now, nor is there a plausible future harm described beyond existing concerns. Therefore, this is best classified as Complementary Information providing context and updates on regulatory responses to prior AI-related safety issues.
Thumbnail Image

California DMV suspends another Pony.ai test permit - The Robot Report

2022-05-26
The Robot Report
Why's our monitor labelling this an incident or hazard?
The event involves the use and malfunction of an AI system (autonomous vehicle technology) that directly caused an accident damaging property. The DMV's suspension of permits and the NHTSA recall are responses to this harm. Therefore, this qualifies as an AI Incident because the AI system's malfunction has directly led to harm (property damage) and regulatory action.
Thumbnail Image

Pony.ai Responds to California DMV Revoking of Automated Driving Test Permit

2022-05-25
Pandaily
Why's our monitor labelling this an incident or hazard?
The event describes a direct harm incident involving Pony.ai's autonomous driving AI system, including a collision accident caused by a software bug, which led to a safety recall. The DMV's revocation of the testing permit due to safety officer driving record violations is related to the use and oversight of the AI system. The AI system's malfunction and regulatory response meet the criteria for an AI Incident, as the AI system's malfunction directly led to harm and regulatory action.
Thumbnail Image

马斯克再立Flag、百度取消主驾安全员,谁能率先实现完全自动驾驶?-36氪

2022-05-27
36氪:关注互联网创业
Why's our monitor labelling this an incident or hazard?
The article primarily provides an update on the state of autonomous driving technology development and regulatory milestones, including the removal of safety drivers in some pilot programs and companies' ambitions to commercialize fully autonomous vehicles. While it involves AI systems (autonomous driving AI), there is no mention of any direct or indirect harm caused by these systems, nor any plausible imminent harm. The content is focused on industry progress, competition, and future prospects rather than incidents or hazards. Therefore, it fits the definition of Complementary Information, as it enhances understanding of the AI ecosystem and ongoing developments without reporting new AI Incidents or AI Hazards.
Thumbnail Image

Robotaxi距离成为"滴滴" 还差几步?-36氪

2022-05-27
36氪:关注互联网创业
Why's our monitor labelling this an incident or hazard?
The article clearly involves AI systems, specifically autonomous driving AI used in Robotaxi services. However, it does not report any injury, violation of rights, disruption, or other harms caused by these AI systems. It also does not describe any near-miss or credible risk of harm that is imminent or demonstrated. Instead, it provides an overview of the industry's progress, challenges, and collaborations, which fits the definition of Complementary Information. The article enhances understanding of the AI ecosystem and the societal and governance context of Robotaxi deployment without reporting an AI Incident or AI Hazard.
Thumbnail Image

Pony.AI被加州吊销自动驾驶许可,小马智行:国内测试正常推进-36氪

2022-05-27
36氪:关注互联网创业
Why's our monitor labelling this an incident or hazard?
The event explicitly involves an AI system for autonomous driving, which is a clear AI system by definition. The revocation of the testing permit is due to safety drivers' poor records and prior accidents involving the autonomous vehicle, indicating the AI system's malfunction or operational failure contributed to safety risks. This directly relates to harm to people or groups (potential injury from accidents) and disruption of safe operation of critical infrastructure (road safety). Hence, it meets the criteria for an AI Incident rather than a hazard or complementary information. The event is not merely a potential risk but involves realized safety issues and regulatory consequences.
Thumbnail Image

小马智行会放弃美国市场吗?-36氪

2022-05-28
36氪:关注互联网创业
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions an AI system (Pony.ai's autonomous driving system) involved in a minor collision during testing in California, which led to the revocation of its autonomous driving testing permits by the California DMV. The incident involved the use and malfunction of the AI system, directly causing a physical event (collision) and regulatory harm (loss of testing license). Although no injuries occurred, the collision and subsequent regulatory response qualify as harm under the framework (harm to property and disruption of operations). Therefore, this is an AI Incident. The rest of the article provides context and analysis but does not change the classification.
Thumbnail Image

加州失意的小马智行,下一站在哪?

2022-05-28
tmtpost.com
Why's our monitor labelling this an incident or hazard?
The event involves an AI system (autonomous driving technology) whose use has directly led to regulatory revocation of testing permits following a minor collision and failure to monitor safety driver records. These are harms related to safety and operational compliance, fitting the definition of an AI Incident. The article details realized harm (minor collision, regulatory action) and the AI system's malfunction or failure to comply with legal frameworks (monitoring safety driver records). Therefore, this is classified as an AI Incident rather than a hazard or complementary information.
Thumbnail Image

马斯克再立Flag、百度取消主驾安全员,谁能率先实现完全自动驾驶?

2022-05-27
凤凰网(凤凰新媒体)
Why's our monitor labelling this an incident or hazard?
The article explicitly involves AI systems in the form of autonomous driving technologies and their deployment. However, it does not describe any realized harm or incident caused by these AI systems. The discussion centers on progress, regulatory approvals, company plans, and market competition, which fits the definition of Complementary Information. There is no direct or indirect harm reported, nor a credible imminent risk of harm described that would qualify as an AI Hazard. Hence, the classification as Complementary Information is appropriate.
Thumbnail Image

证券时报网讯,据正大集团消息,5月27日,来自泰国的大型跨国企业正大集团与来自中国的智能自动驾驶飞行器科技企业亿航智能控股有限公司达成战略合作伙伴关系,计划在泰国建立合资公司,以开展自动驾驶飞行器的销售与城市空中交通(UAM)业务。

2022-05-27
证券之星
Why's our monitor labelling this an incident or hazard?
The involvement of intelligent autonomous flying vehicles indicates the presence of AI systems. However, the article only reports on the formation of a business partnership and plans for future operations without any mention of harm or incidents caused by these AI systems. There is no indication of realized harm or direct risk at this stage, only potential future use. Therefore, this event represents a plausible future risk scenario related to AI systems but does not describe any actual harm or incident yet.
Thumbnail Image

亿航智能(EH.US)宣布与泰国大型集团企业正大集团达成战略合作伙伴关系。

2022-05-27
证券之星
Why's our monitor labelling this an incident or hazard?
The article involves AI systems (autonomous flying vehicles) and their planned deployment, which could plausibly lead to future harms such as safety incidents or regulatory challenges. However, since no harm or incident has occurred or is reported, and the article mainly announces a partnership and future plans, it fits the definition of an AI Hazard rather than an AI Incident or Complementary Information.