Hesai Lidar Malfunction Disrupts US Autonomous Fleets Amid National Security Concerns

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Chinese lidar maker Hesai, partnered with Nvidia, experienced a firmware error that disrupted multiple US autonomous vehicle fleets for over 24 hours. The incident raised national security concerns due to Hesai's blacklisting by the US Department of Defense and potential risks of data exfiltration and malware manipulation in critical infrastructure.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly involves AI systems (lidar sensors integrated into autonomous vehicle architectures) and discusses their deployment and potential security vulnerabilities. While no direct harm has occurred, credible expert warnings and demonstrations indicate plausible risks of harm to critical infrastructure and physical safety if the sensors are compromised or misused. The event does not describe an actual incident but highlights a credible potential for harm, fitting the definition of an AI Hazard. The article also includes governance and policy responses, but the main focus is on the plausible future harm from the AI system's use and origin.[AI generated]
AI principles
Robustness & digital securitySafety

Industries
Mobility and autonomous vehicles

Affected stakeholders
Business

Harm types
Economic/PropertyPublic interest

Severity
AI hazard

AI system task:
Recognition/object detection


Articles about this incident or hazard