AI Health Code System Failure Disrupts COVID-19 Control in Xi'an

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

The AI-powered 'Yima Tong' health code system in Xi'an malfunctioned due to overload, causing widespread disruption to hospital access, public transport, and community health screening during a critical COVID-19 outbreak. The failure led to crowding, delays, and hindered epidemic control, highlighting the risks of AI system reliability in public health infrastructure.[AI generated]

Why's our monitor labelling this an incident or hazard?

The health code system ('一码通') is an AI-related system used for pandemic control, involving data processing and verification of health status. The repeated malfunction caused direct harm by disrupting citizens' ability to access public services and comply with health regulations, impacting community health and daily life. The article explicitly states the system's failure and its consequences, indicating a malfunction leading to harm. Hence, it meets the criteria for an AI Incident, as the AI system's malfunction directly led to harm to communities and disruption of critical public health infrastructure.[AI generated]
AI principles
Robustness & digital securitySafetyAccountabilityHuman wellbeing

Industries
Government, security, and defenceHealthcare, drugs, and biotechnologyMobility and autonomous vehicles

Affected stakeholders
General publicGovernment

Harm types
Public interest

Business function:
Monitoring and quality control

AI system task:
Forecasting/prediction


Articles about this incident or hazard