Boeing 737 Max AI System Malfunction Leads to Fatal Crashes and Regulatory Overhaul

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

The Boeing 737 Max's automated flight control system (MCAS), an AI-driven component, malfunctioned and caused two fatal crashes, killing 346 people. Regulators now demand significant design changes and extensive testing of the AI system before the aircraft can return to service, highlighting the risks of flawed AI in aviation.[AI generated]

Why's our monitor labelling this an incident or hazard?

The Boeing 737 Max's automated flight control system qualifies as an AI system because it makes automated decisions based on sensor data to control the aircraft. The two crashes caused by this system's malfunction led to the deaths of 346 people, which is a direct harm to human health and life. The article discusses the upcoming testing to evaluate changes to this system, which is part of the response to the incident. Since the harm has already occurred due to the AI system's malfunction, this event is classified as an AI Incident. The current testing is part of remediation but does not negate the fact that the AI system's malfunction caused fatal harm.[AI generated]
AI principles
Robustness & digital securitySafetyAccountabilityTransparency & explainabilityDemocracy & human autonomyRespect of human rights

Industries
Mobility and autonomous vehicles

Affected stakeholders
ConsumersWorkers

Harm types
Physical (death)Reputational

Severity
AI incident

Business function:
Other

AI system task:
Goal-driven organisation


Articles about this incident or hazard

Thumbnail Image

Boeing jumps after FAA confirms 737 max test flights to begin

2020-06-29
chinadailyhk
Why's our monitor labelling this an incident or hazard?
The article involves an AI system only indirectly, if at all, since the 737 Max's flight-control software includes automated systems that contributed to past crashes. However, the current event is about the approval to start test flights after fixes, not about a new incident or harm caused by AI. No new injury, violation, or harm is reported; the event is about ongoing safety certification and regulatory oversight. Therefore, it does not qualify as an AI Incident or AI Hazard. It is best classified as Complementary Information, providing context and updates on the regulatory process and safety assessments related to AI-involved systems in aviation.
Thumbnail Image

Flight testing for Boeing's grounded 737 Max could begin Monday

2020-06-29
USA TODAY
Why's our monitor labelling this an incident or hazard?
The Boeing 737 Max's automated flight control system qualifies as an AI system because it makes automated decisions based on sensor data to control the aircraft. The two crashes caused by this system's malfunction led to the deaths of 346 people, which is a direct harm to human health and life. The article discusses the upcoming testing to evaluate changes to this system, which is part of the response to the incident. Since the harm has already occurred due to the AI system's malfunction, this event is classified as an AI Incident. The current testing is part of remediation but does not negate the fact that the AI system's malfunction caused fatal harm.
Thumbnail Image

Boeing gets go-ahead for test flights of troubled 737 Max

2020-06-29
ABS-CBN News
Why's our monitor labelling this an incident or hazard?
The event involves an AI system component, specifically the MCAS software, which is an automated flight control system that contributed to fatal crashes. The crashes caused injury and death, fulfilling the harm criteria. The event focuses on the development and use of the AI system (MCAS) and its malfunction leading to harm. Although the current event is about test flights and regulatory approval, the underlying issue is an AI Incident because the AI system's malfunction directly led to fatal crashes. Therefore, this event is best classified as an AI Incident due to the realized harm caused by the AI system's malfunction in the past, which is the context for the current testing and approval process.
Thumbnail Image

Foreign regulators demand substantial changes to Boeing Max | HeraldNet.com

2020-06-25
HeraldNet.com
Why's our monitor labelling this an incident or hazard?
The Boeing 737 Max's MCAS system is an AI system involved in flight control decisions. Its malfunction directly led to two fatal crashes causing loss of life, which is injury or harm to persons, thus qualifying as an AI Incident. The article focuses on regulatory responses demanding design changes to fix these AI system flaws to prevent further harm. Therefore, this event is an AI Incident due to the realized harm caused by the AI system's malfunction and the ongoing regulatory actions to address it.