Fatal Accident on Shanghai Driverless Metro Due to AI System Failure

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A female passenger died after being trapped by a platform screen door and struck by a driverless train on Shanghai Metro Line 15, which uses a fully automated AI-based system. The incident is attributed to a malfunction or operational error in the AI-controlled safety mechanisms, raising concerns about the system's reliability and emergency response.[AI generated]

Why's our monitor labelling this an incident or hazard?

The incident involves a fully automated driverless train system (an AI system) whose operation directly led to a passenger being trapped and killed. The train started moving despite the door obstruction due to the manual override of safety controls (LCB settings) and delayed emergency stop activation. This is a direct harm caused by the AI system's use and malfunction, meeting the criteria for an AI Incident under harm to health. The event is not merely a potential hazard or complementary information but a realized harm caused by the AI system's operation and safety management failures.[AI generated]
AI principles
SafetyRobustness & digital securityAccountabilityTransparency & explainabilityRespect of human rightsHuman wellbeingDemocracy & human autonomy

Industries
Mobility and autonomous vehiclesRobots, sensors, and IT hardwareGovernment, security, and defence

Affected stakeholders
Consumers

Harm types
Physical (death)PsychologicalReputationalEconomic/PropertyPublic interestHuman or fundamental rights

Severity
AI incident

Business function:
Monitoring and quality controlMaintenance

AI system task:
Recognition/object detectionEvent/anomaly detectionGoal-driven organisation


Articles about this incident or hazard

Thumbnail Image

为何列车夹人时仍启动?记者实地调查:应先按紧急停车按钮 - cnBeta.COM 移动版

2022-01-26
cnBeta.COM
Why's our monitor labelling this an incident or hazard?
The incident involves a fully automated driverless train system (an AI system) whose operation directly led to a passenger being trapped and killed. The train started moving despite the door obstruction due to the manual override of safety controls (LCB settings) and delayed emergency stop activation. This is a direct harm caused by the AI system's use and malfunction, meeting the criteria for an AI Incident under harm to health. The event is not merely a potential hazard or complementary information but a realized harm caused by the AI system's operation and safety management failures.
Thumbnail Image

乘客被夹身亡线路开通无人驾驶刚1年 上海地铁回应:将全力配合调查 - 人物 - cnBeta.COM

2022-01-25
cnBeta.COM
Why's our monitor labelling this an incident or hazard?
The event involves a fully automated driverless metro line, which is an AI system controlling train operations. The passenger's death due to being caught by doors while the train was operating under this AI system indicates direct harm linked to the AI system's use. Although the investigation is ongoing, the AI system's involvement in the operation that led to the fatality is clear. Therefore, this is an AI Incident as the AI system's use has directly led to harm to a person.
Thumbnail Image

上海女子被地铁屏蔽门夹住身亡 - 大纪元

2022-01-25
The Epoch Times
Why's our monitor labelling this an incident or hazard?
The Shanghai Metro Line 15 is described as a fully automated, driverless train system, which implies the involvement of AI systems for train operation and platform screen door coordination. The incident occurred when a passenger was trapped by the platform screen doors and subsequently killed, indicating a failure or malfunction in the AI system's operation or safety protocols. This directly caused harm to a person, fulfilling the criteria for an AI Incident. The event is not merely a potential hazard or complementary information but a realized harm caused by the AI system's use or malfunction.
Thumbnail Image

为何列车夹人时仍启动?记者实地调查:应先按紧急停车按钮

2022-01-26
驱动之家
Why's our monitor labelling this an incident or hazard?
The Shanghai Metro Line 15 is a fully automated driverless system, which by definition involves AI systems controlling train movement and door operations. The incident where a passenger was trapped and the train started moving, resulting in death, is a direct harm caused by the AI system's malfunction or improper safety protocol execution. The investigation points to possible issues with manual overrides and emergency stop button usage, but the AI system's role in train movement and door control is central. Hence, this is an AI Incident involving injury and death caused by the AI system's use and malfunction.
Thumbnail Image

乘客被夹身亡线路开通无人驾驶刚1年 上海地铁回应:将全力配合调查

2022-01-25
驱动之家
Why's our monitor labelling this an incident or hazard?
The Shanghai Metro Line 15 uses a fully automated driverless system, which is an AI system controlling train operations and platform safety mechanisms such as screen doors. The passenger was fatally injured when trapped by the platform screen doors, an event directly linked to the AI system's operation or malfunction. Although the investigation is ongoing, the AI system's role in the incident is clear and the harm (death of a passenger) has occurred. Therefore, this event meets the criteria for an AI Incident due to direct harm caused by the use of an AI system.
Thumbnail Image

上海地铁惊传老妇被站台门夹死 列车卷走惊悚画面曝光(视频) - 新闻 上海 - 看中国新闻网 - 海外华人 历史秘闻 社会百态 -

2022-01-25
看中国
Why's our monitor labelling this an incident or hazard?
The incident clearly involves an AI system because the train is described as driverless, implying autonomous operation controlled by AI. The harm (death of a passenger) was directly caused by the train starting to move while the passenger was trapped, indicating a failure in the AI system's sensing or safety mechanisms. The event also includes possible human error in emergency response, but the AI system's malfunction is pivotal. This meets the criteria for an AI Incident as it caused injury and death to a person due to the AI system's malfunction and use.
Thumbnail Image

国内最高等级无人驾驶线路开通刚1年!上海地铁回应女乘客被夹身亡:将全力配合调查

2022-01-25
和讯网
Why's our monitor labelling this an incident or hazard?
The Shanghai metro line 15 uses a fully automated driving system, which fits the definition of an AI system. The fatal accident involving a passenger being caught by the platform screen door occurred during the operation of this AI system. Although the exact cause is under investigation, the AI system's involvement in the operation and safety mechanisms is central to the incident. The harm (death) has occurred, making this an AI Incident rather than a hazard or complementary information. The event is not unrelated as it directly involves an AI system and a resulting harm.
Thumbnail Image

上海全自动驾驶地铁列车发生重大事故 一女性乘客被夹身亡

2022-01-25
hi.online.sh.cn
Why's our monitor labelling this an incident or hazard?
The subway train is described as fully automated, implying the presence of an AI system controlling its operation. The incident occurred because the train started moving while the passenger was trapped, indicating a malfunction or failure in the AI system's safety mechanisms. This directly caused the death of the passenger, which qualifies as injury or harm to a person. Therefore, this event meets the criteria for an AI Incident.
Thumbnail Image

乘客被地铁屏蔽门夹死 专业人士:或是站务员操作失误

2022-01-25
app.myzaker.com
Why's our monitor labelling this an incident or hazard?
The Shanghai Metro Line 15 uses a fully automated driving system, which is an AI system controlling train operations. The fatality occurred because the platform screen door and train movement were not properly coordinated, leading to a passenger being trapped and crushed. The incident directly caused injury and death, fulfilling the criteria for harm to a person. The involvement of the AI system is explicit (fully automated line) and the harm resulted from its use or malfunction (failure to prevent the train from starting while the door was not properly closed). Therefore, this is classified as an AI Incident.
Thumbnail Image

女乘客被自动地铁屏蔽门夹住,不幸身亡,事故原因究竟出在哪?

2022-01-25
163.com
Why's our monitor labelling this an incident or hazard?
The event explicitly involves an AI system (ATO) controlling the subway train's automatic driving and door operations. The malfunction and human error in operating the system directly caused the death of a passenger, which is a harm to a person. The AI system's role is pivotal as it controls train movement and door safety mechanisms. The incident is not merely a potential risk but a realized harm, thus qualifying as an AI Incident rather than a hazard or complementary information.
Thumbnail Image

痛心!上海地铁车被夹女乘客不幸身亡,为什么地铁没有紧急停止

2022-01-25
163.com
Why's our monitor labelling this an incident or hazard?
The event involves an AI system explicitly: the ATO driverless metro system controlling train movement and door operations. The harm (death of a passenger) directly resulted from the interaction of the AI system's operation and safety mechanisms, including the platform screen door sensors and emergency stop button usage. The malfunction or procedural failure in the AI system's safety protocols (e.g., train starting despite door not fully closed, delayed emergency stop) directly led to the fatality. Hence, it meets the criteria for an AI Incident due to injury/harm to a person caused directly or indirectly by the AI system's use and malfunction.
Thumbnail Image

无人驾驶惹祸!上海地铁"乘客"被挤死:疑工作人员操作失误!

2022-01-25
163.com
Why's our monitor labelling this an incident or hazard?
The metro line is described as unmanned and operating autonomously, which implies the presence of an AI system controlling train movement. The train started moving automatically once the safety interlock was disengaged, which was done incorrectly by staff, leading to the passenger being dragged and killed. The AI system's autonomous operation was a direct factor in the harm, and the staff's error in handling the safety system exacerbated the incident. The harm (death of a passenger) is clearly linked to the AI system's operation and the human error in its use, fulfilling the criteria for an AI Incident involving injury to a person due to AI system use and malfunction.
Thumbnail Image

天鼎证券:如何看待上海地铁女乘客被夹身亡

2022-01-25
163.com
Why's our monitor labelling this an incident or hazard?
The event clearly involves an AI system, specifically a GoA4 fully automated driverless metro line, which is an AI system controlling train operations and door mechanisms. The incident resulted in a passenger's death, which is a direct harm to a person caused by the malfunction or failure of the AI system's safety functions and emergency protocols. Therefore, this qualifies as an AI Incident because the AI system's malfunction and operational design directly led to a fatal injury. The discussion of emergency response and design improvements supports the classification but does not change the primary classification as an incident.
Thumbnail Image

上海无人驾驶地铁线路乘客被夹身亡 刚开通一年

2022-01-25
163.com
Why's our monitor labelling this an incident or hazard?
The metro line is described as fully automated and driverless, implying AI system involvement in train control and safety features such as platform screen doors. The passenger's death due to being trapped by the screen door and the train's movement during rescue efforts indicates a malfunction or failure in the AI-operated system or its safety protocols. This directly led to harm (death), fulfilling the criteria for an AI Incident. The event is not merely a potential hazard or complementary information but a realized harm linked to an AI system's operation.
Thumbnail Image

上海全自动驾驶地铁列车发生重大事故 一女性乘客被夹身亡

2022-01-25
163.com
Why's our monitor labelling this an incident or hazard?
The incident involves a fully automated subway train (an AI system) whose operation directly led to a fatal injury of a passenger. The train started moving while the platform screen door was still closed and the passenger was trapped, indicating a malfunction or failure in the AI system's safety protocols or operational logic. This caused direct harm to a person, fulfilling the criteria for an AI Incident under the definition of injury or harm to health caused by the use or malfunction of an AI system. Therefore, this event qualifies as an AI Incident.
Thumbnail Image

独家 上海地铁女乘客被屏蔽门夹住身亡,小时新闻连线专业人士:... 深度178号 1小时前

2022-01-25
thehour.cn
Why's our monitor labelling this an incident or hazard?
The subway system employs a fully automated AI-based driving system controlling train departure and door interlocks. The incident resulted from either a malfunction or operational error in this AI-controlled system, leading to a fatality. The AI system's malfunction or misuse directly caused harm to a person, fitting the definition of an AI Incident involving injury or harm to health due to AI system use or malfunction.