通用研发L3自动驾驶系统 高管称即将达到重要里程碑
2024-10-06
中关村在线
The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
Several incidents in China involved drivers misusing or over-relying on AI-powered autonomous driving systems, leading to highway collisions and hazardous situations. In one case, a Tesla on Autopilot crashed into barriers; in another, a driver slept while tricking the system. These events highlight the dangers of current AI driving technologies and user complacency.[AI generated]
Why's our monitor labelling this an incident or hazard?
The event involves an AI system explicitly: the automated driving system (ADAS) in the vehicle. The driver misused the system by tricking it to allow hands-free driving while being inattentive and asleep, which directly created a hazardous situation on a highway. The article also references multiple past accidents caused by similar AI systems, some fatal, establishing a pattern of harm linked to the use and misuse of these AI systems. The misuse and malfunction of the AI system have directly or indirectly led to harm or risk of harm to human life, fulfilling the criteria for an AI Incident. Although the specific incident described did not result in an accident, the direct risk to life and the history of actual accidents caused by such systems justify classification as an AI Incident rather than a mere hazard.[AI generated]