AITO M5 Intelligent Driving Demo Causes Crash and Injuries During Test Drive

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

During a test drive in Hubei, China, an AITO M5 vehicle's intelligent driving (autonomous) system failed to brake when a bus turned ahead, resulting in a collision. The sales representative had both hands off the wheel, relying on the AI system. The crash caused significant injuries to the customer and passenger.[AI generated]

Why's our monitor labelling this an incident or hazard?

The vehicle was in intelligent driving mode, which implies the use of an AI system for autonomous or assisted driving. The accident occurred because the AI system did not take timely emergency braking action, leading to a collision and physical injuries. This is a direct harm caused by the AI system's malfunction or failure to act appropriately. Therefore, this qualifies as an AI Incident under the definition of harm to a person caused directly or indirectly by the use or malfunction of an AI system.[AI generated]
AI principles
SafetyRobustness & digital securityAccountabilityTransparency & explainabilityHuman wellbeing

Industries
Mobility and autonomous vehicles

Affected stakeholders
Consumers

Harm types
Physical (injury)

Severity
AI incident

Business function:
Sales

AI system task:
Recognition/object detectionForecasting/predictionEvent/anomaly detectionGoal-driven organisation


Articles about this incident or hazard

Thumbnail Image

试驾问界车祸致骨折 自动驾驶功能引争议_中华网

2024-09-20
中华网科技公司
Why's our monitor labelling this an incident or hazard?
The vehicle was in intelligent driving mode, which implies the use of an AI system for autonomous or assisted driving. The accident occurred because the AI system did not take timely emergency braking action, leading to a collision and physical injuries. This is a direct harm caused by the AI system's malfunction or failure to act appropriately. Therefore, this qualifies as an AI Incident under the definition of harm to a person caused directly or indirectly by the use or malfunction of an AI system.
Thumbnail Image

男子称试驾问界M5撞上公交车:销售人员演示智驾功能,双手离开方向盘

2024-09-19
app.myzaker.com
Why's our monitor labelling this an incident or hazard?
The event involves an AI system explicitly described as the intelligent driving feature of the vehicle, which was in use during the test drive. The AI system's failure to perform emergency braking when a bus turned in front of the vehicle led to a collision causing injuries and property damage. This meets the criteria for an AI Incident because the AI system's malfunction directly led to harm to persons and property. The involvement is clear and direct, and the harm is realized, not just potential.
Thumbnail Image

男子称试驾问界M5撞上公交车:销售人员演示智驾功能,双手离开方向盘

2024-09-19
新浪新闻中心
Why's our monitor labelling this an incident or hazard?
The event involves an AI system explicitly mentioned as the intelligent driving feature of the vehicle. The accident and resulting injuries directly stem from the use and malfunction (or failure) of this AI system, which did not intervene to prevent the collision despite the sales personnel removing their hands from the steering wheel. This meets the criteria for an AI Incident because the AI system's use directly led to harm to persons and property damage. Therefore, the event is classified as an AI Incident.
Thumbnail Image

试驾问界M5发生车祸致顾客受伤 销售开车曾双手离开方向盘:官方回应正处理

2024-09-19
驱动之家
Why's our monitor labelling this an incident or hazard?
The event explicitly involves an AI system, the intelligent driving feature of the AITO M5 vehicle, which was active during the test drive. The sales driver had both hands off the steering wheel, relying on the AI system, which failed to perform emergency braking to avoid a collision with a bus. This failure directly caused a traffic accident resulting in physical injuries to the customer. The AI system's malfunction or inadequate performance in a safety-critical scenario led to harm, meeting the criteria for an AI Incident under the OECD framework.
Thumbnail Image

用户试乘问界M5出事故受伤 自动驾驶功能受质疑_中华网

2024-09-19
中华网科技公司
Why's our monitor labelling this an incident or hazard?
The event explicitly involves an AI system in the form of an intelligent driving/autonomous driving function. The accident occurred during the use of this AI system, with the system failing to brake in time, causing a collision and resulting in physical injuries. This meets the criteria for an AI Incident as the AI system's malfunction directly led to harm to persons. The presence of injuries and the system's failure to act appropriately confirm the incident classification rather than a hazard or complementary information.
Thumbnail Image

问界M5销售开车演示智驾,不料撞上公交车!涉事门店回应

2024-09-19
新浪财经
Why's our monitor labelling this an incident or hazard?
The event explicitly involves the use of an AI system, namely the intelligent driving (smart driving) feature of the Wenjie M5 vehicle, which is an AI system as it infers from input to control vehicle behavior. The accident occurred during a demonstration of this AI system, where the driver took hands off the wheel, relying on the AI system, which failed to respond appropriately to a bus turning left, leading to a collision and injuries. This is a direct harm to persons and property caused by the AI system's use and possible malfunction or misuse. The article also references previous similar incidents, reinforcing the safety risks of the AI system in use. Hence, this event meets the criteria for an AI Incident.
Thumbnail Image

试驾问界M5撞上公交车,销售开智驾没扶方向盘?门店回应...此前被曝起火

2024-09-19
新浪财经
Why's our monitor labelling this an incident or hazard?
The event explicitly involves an AI system—the intelligent driving system integrated into the AITO M5 vehicle. The accident occurred during the use of this AI system, where the driver relied on the AI but did not maintain control (hands off the wheel) and failed to brake in time, leading to a collision with a bus. The resulting injuries to the passengers and vehicle damage constitute direct harm. The AI system's role is pivotal as it was engaged and expected to assist or intervene in driving safety, but the failure to act or the system's limitations contributed to the incident. Hence, this is an AI Incident under the OECD framework.
Thumbnail Image

销售开车演示智驾,不料问界M5撞上公交车_手机网易网

2024-09-19
m.163.com
Why's our monitor labelling this an incident or hazard?
The event explicitly involves an AI system, the intelligent driving (autonomous driving) mode of the Wenjie M5 vehicle, which was demonstrated during a test drive. The AI system's failure to brake or respond to the bus's maneuver directly caused a collision, resulting in serious injuries to the driver and passenger. This meets the definition of an AI Incident because the AI system's malfunction during use directly led to injury and harm to persons. The event is not merely a potential hazard or complementary information but a realized harm caused by the AI system's malfunction.
Thumbnail Image

试驾问界M5撞上公交车,销售开智驾没扶方向盘?门店回应...此前被曝起火_手机网易网

2024-09-19
m.163.com
Why's our monitor labelling this an incident or hazard?
The event explicitly involves an AI system—the intelligent driving system in the AITO M5 vehicle. The system was active during the accident, and the sales person relied on it but did not maintain control (hands off the wheel) and did not perform emergency braking. The collision caused injuries to the passengers and vehicle damage, fulfilling the harm criteria. The AI system's malfunction or inadequate performance directly led to the harm, making this an AI Incident. The report also mentions prior safety concerns (a previous fire), but the main event here is the crash caused by the AI driving system's failure to prevent it.
Thumbnail Image

专家谈问界试驾事故 智驾演示风险引关注_中华网

2024-09-19
中华网科技公司
Why's our monitor labelling this an incident or hazard?
The event involves an AI system, namely the intelligent driving (autonomous driving) feature of the AITO Wenjie M5 vehicle. The accident occurred during the use of this AI system in a real-world scenario, where the AI system's operation (or misuse by the sales personnel) directly led to a collision causing physical injury. This fits the definition of an AI Incident because the AI system's use directly led to harm to persons. The discussion about legal responsibility and safety practices further supports the classification as an incident rather than a hazard or complementary information. Therefore, the event is classified as an AI Incident.
Thumbnail Image

试驾问界M5车祸致顾客受伤,销售双手离盘引争议:官方称正处理

2024-09-20
k.sina.com.cn
Why's our monitor labelling this an incident or hazard?
The event involves an AI system (intelligent driving assistance) whose use during a test drive directly led to a traffic accident causing injuries to the customers. The sales personnel's failure to maintain control and timely intervene while the AI system was active contributed to the collision. This meets the definition of an AI Incident because the AI system's use directly caused harm to persons. The article also references previous similar incidents, reinforcing the pattern of harm linked to this AI system's use. Therefore, this is classified as an AI Incident.