Tesla FSD Recall and Safety Concerns Over Rolling Stops and Near-Misses

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Tesla's Full Self-Driving (FSD) AI system faced a recall affecting 54,000 vehicles after it allowed cars to perform illegal rolling stops at intersections, posing safety risks. Additionally, user tests in Boston revealed frequent AI failures and required human interventions to avoid near-crashes, highlighting ongoing safety concerns with the technology.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves an AI system (Tesla's Full Self-Driving Beta autonomous driving system) malfunctioning by not stopping at stop signs, which is a direct safety hazard. This malfunction could lead to injury or harm to persons or property, fulfilling the criteria for an AI Incident. The recall and planned software update indicate recognition of the harm risk. Since the malfunction is already identified and the recall is underway, this is not merely a potential hazard but an incident due to the direct link between the AI system's failure and the risk of harm.[AI generated]
AI principles
SafetyRobustness & digital securityAccountabilityTransparency & explainabilityDemocracy & human autonomy

Industries
Mobility and autonomous vehiclesConsumer products

Affected stakeholders
ConsumersGeneral public

Harm types
Physical (injury)Economic/PropertyReputational

Business function:
ManufacturingMonitoring and quality control

AI system task:
Recognition/object detectionGoal-driven organisationReasoning with knowledge structures/planningForecasting/prediction

In other databases


Articles about this incident or hazard