Boeing 737 Max MCAS AI System Linked to Fatal Crashes and Regulatory Misconduct

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Boeing's automated MCAS flight control system, classified as AI, was central to two fatal 737 Max crashes. Investigations allege Boeing employees, including the chief technical pilot, misled regulators about MCAS's safety, leading to administrative suspensions and a federal criminal probe into the company's conduct.[AI generated]

Why's our monitor labelling this an incident or hazard?

The MCAS is an AI system that automatically controls flight parameters to influence the plane's behavior. Its flawed design and misleading information provided to regulators have been directly linked to two fatal crashes, causing significant loss of life. The DOJ investigation into whether Boeing knowingly misled regulators about MCAS's safety relates to the development and use of this AI system leading to harm and violations of safety regulations. Therefore, this event qualifies as an AI Incident due to direct harm caused by the AI system's malfunction and regulatory breaches.[AI generated]
AI principles
AccountabilityRespect of human rightsRobustness & digital securitySafetyTransparency & explainability

Industries
Mobility and autonomous vehicles

Affected stakeholders
ConsumersWorkers

Harm types
Physical (death)

Severity
AI incident

Business function:
Other

AI system task:
Goal-driven organisation


Articles about this incident or hazard

Thumbnail Image

The DOJ is reportedly probing whether Boeing's chief pilot misled regulators over the 737 Max

2020-02-21
Business Insider
Why's our monitor labelling this an incident or hazard?
The MCAS is an AI system that automatically controls flight parameters to influence the plane's behavior. Its flawed design and misleading information provided to regulators have been directly linked to two fatal crashes, causing significant loss of life. The DOJ investigation into whether Boeing knowingly misled regulators about MCAS's safety relates to the development and use of this AI system leading to harm and violations of safety regulations. Therefore, this event qualifies as an AI Incident due to direct harm caused by the AI system's malfunction and regulatory breaches.
Thumbnail Image

Boeing Suspends Co-Workers of Pilot at Center of Max Scrutiny

2020-02-22
Bloomberg.com
Why's our monitor labelling this an incident or hazard?
The MCAS is an automated flight control system that can be reasonably classified as an AI system due to its autonomous decision-making to adjust aircraft behavior. The article details how the system's design and operation were central to two fatal crashes, causing loss of life, which is a direct harm to people. The investigation into misleading regulators about the system's capabilities and safety further ties the AI system's development and use to the harm. Therefore, this event meets the criteria for an AI Incident due to direct harm caused by the AI system's malfunction and misrepresentation.
Thumbnail Image

Boeing, crash victims' lawyers negotiate over access to 737 MAX...

2020-02-19
U.S.
Why's our monitor labelling this an incident or hazard?
The Boeing 737 MAX crashes involved the aircraft's automated flight control system, which is an AI system as it infers from sensor inputs to adjust flight controls. The crashes resulted in fatalities, constituting harm to persons. The event describes ongoing legal proceedings and document access disputes related to the AI system's design and its role in the crashes. Since the AI system's malfunction directly led to harm, this qualifies as an AI Incident. The article focuses on the aftermath and legal process but the core event is the fatal crashes caused by the AI system's failure.