Fatal braking failure sparks safety concerns for China’s Wuhan robotaxi fleet

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

In Wuhan, China’s self-driving robotaxi fleet of over 500 vehicles faces scrutiny after a Huawei-backed Aito car’s automatic braking system failed, causing a fatal accident and a minor collision with a jaywalker. These incidents underscore persistent safety risks amid rapid AI taxi deployment.[AI generated]

Why's our monitor labelling this an incident or hazard?

The presence of AI systems is explicit in the autonomous taxis operating in Wuhan. The article mentions a fatal accident caused by the failure to activate the automatic braking system, which is an AI malfunction leading to injury or death. Additionally, a minor collision with a pedestrian occurred, renewing safety concerns. These constitute direct harm caused by the AI system's use and malfunction, fitting the definition of an AI Incident.[AI generated]
AI principles
SafetyRobustness & digital securityAccountabilityTransparency & explainabilityDemocracy & human autonomyHuman wellbeingRespect of human rights

Industries
Mobility and autonomous vehiclesRobots, sensors, and IT hardwareConsumer services

Affected stakeholders
General public

Harm types
Physical (death)Physical (injury)ReputationalEconomic/PropertyPublic interest

Business function:
Monitoring and quality controlMaintenance

AI system task:
Recognition/object detectionGoal-driven organisationReasoning with knowledge structures/planning


Articles about this incident or hazard