Tesla FSD Beta 10.6 Malfunctions Pose Safety Risks During Real-World Testing

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Multiple reports and user tests reveal that Tesla's FSD Beta 10.6 autonomous driving system exhibits serious malfunctions, including delayed mapping, unauthorized lane changes, near-collisions with pedestrians, and hesitation during driver control handover. These AI failures occurred during real-world tests in the United States, raising significant safety concerns.[AI generated]

Why's our monitor labelling this an incident or hazard?

The Tesla FSD Beta 10.6 is an AI system for autonomous driving. The reported issues such as unintended lane usage, near collisions with pedestrians, and control malfunctions directly relate to the AI system's malfunction during use. These malfunctions have caused or nearly caused physical harm to people, fulfilling the criteria for an AI Incident under harm category (a) injury or harm to health. The event is not merely a potential hazard or complementary information but describes actual malfunctions with direct safety implications. Therefore, it qualifies as an AI Incident.[AI generated]
AI principles
SafetyRobustness & digital securityAccountability

Industries
Mobility and autonomous vehicles

Affected stakeholders
ConsumersGeneral public

Harm types
Physical (injury)

AI system task:
Recognition/object detectionGoal-driven organisation


Articles about this incident or hazard