Fatalities Surge in South Korea Due to ACC AI System Limitations on Highways

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

In South Korea, the use of Adaptive Cruise Control (ACC), an AI-based driver assistance system, on highways has led to a fatality rate six times higher than regular accidents. ACC's failure to detect stopped vehicles and construction zones resulted in multiple deadly crashes, prompting warnings about overreliance on the technology.[AI generated]

Why's our monitor labelling this an incident or hazard?

ACC is an AI system that assists driving by sensing and controlling vehicle speed and distance. The article documents actual accidents and fatalities directly linked to the use of ACC, indicating harm to persons. The increased fatality rate and the warnings about the system's limitations confirm that the AI system's use has directly or indirectly caused harm. Therefore, this qualifies as an AI Incident. The mention of future AI-based safety robots is complementary and does not change the classification.[AI generated]
AI principles
SafetyRobustness & digital security
Industries
Mobility and autonomous vehicles
Affected stakeholders
ConsumersGeneral public
Harm types
Physical (death)
AI system task:
Recognition/object detectionGoal-driven organisation

Articles about this incident or hazard