NHTSA Investigates Freightliner Trucks for AI-Driven Phantom Braking Incidents

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

The National Highway Traffic Safety Administration is investigating Daimler's Freightliner Cascadia trucks (2017-2022) after 18 complaints that their AI-powered automatic emergency braking system activates without obstacles, causing unexpected stops. No injuries have been reported, but the malfunction poses significant safety risks to drivers and road users.[AI generated]

Why's our monitor labelling this an incident or hazard?

The auto emergency braking system is an AI system as it autonomously detects road conditions and decides when to brake. The phantom braking is a malfunction of this AI system causing unintended emergency stops, which directly endangers drivers' safety. The NHTSA investigation and complaints confirm that harm or risk of harm has materialized. Therefore, this event meets the criteria for an AI Incident due to the AI system's malfunction leading to potential injury or harm to persons.[AI generated]
AI principles
SafetyRobustness & digital securityTransparency & explainabilityAccountabilityDemocracy & human autonomy

Industries
Mobility and autonomous vehiclesLogistics, wholesale, and retail

Affected stakeholders
WorkersGeneral public

Harm types
Physical (injury)Economic/PropertyReputational

Business function:
ManufacturingMonitoring and quality control

AI system task:
Recognition/object detectionGoal-driven organisation


Articles about this incident or hazard