Tesla Full Self-Driving Beta Raises Safety Concerns and Triggers Regulatory Action in California

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

California passed a law banning Tesla from marketing its AI-powered driving software as 'Full Self-Driving' due to concerns over misleading claims and potential safety risks. User tests, including unedited footage by Marques Brownlee, highlight frequent disengagements and stress, underscoring the system's current limitations and hazards.[AI generated]

Why's our monitor labelling this an incident or hazard?

Tesla's Full Self-Driving beta software is an AI system involved in real-time autonomous vehicle control. The video and report show that the AI system failed to recognize critical road elements (construction zones, traffic cones) and struggled with complex driving scenarios, requiring human intervention to maintain safety. This indicates a malfunction or limitation in the AI system's use that directly impacts driver safety and well-being, fulfilling the criteria for an AI Incident under harm to health and safety. Although no accident occurred, the stress and potential risk to physical safety are significant harms. Therefore, this event qualifies as an AI Incident rather than a hazard or complementary information.[AI generated]
AI principles
SafetyTransparency & explainabilityAccountabilityRobustness & digital securityHuman wellbeingDemocracy & human autonomy

Industries
Mobility and autonomous vehiclesGovernment, security, and defenceMedia, social platforms, and marketing

Affected stakeholders
ConsumersGeneral public

Harm types
Physical (injury)PsychologicalReputationalPublic interest

Business function:
Marketing and advertisementMonitoring and quality control

AI system task:
Recognition/object detectionReasoning with knowledge structures/planningGoal-driven organisation


Articles about this incident or hazard