US Investigates Tesla Autopilot After Fatal Crashes and Driver Misuse

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

US regulators are investigating Tesla's Autopilot and Full Self-Driving AI systems after at least 14 deaths and multiple crashes involving emergency vehicles. The probe focuses on system changes, driver monitoring, and misuse, including devices that trick the AI, prompting recalls and removal of such products from online retailers.[AI generated]

Why's our monitor labelling this an incident or hazard?

Tesla's Autopilot is an AI system providing partially automated driving capabilities. The crashes involving Teslas on Autopilot hitting emergency vehicles have caused fatalities, constituting direct harm to persons. The investigation and regulatory request for details on system changes relate to the AI system's use and possible malfunction leading to these harms. Therefore, this event qualifies as an AI Incident due to realized harm linked to the AI system's operation.[AI generated]
AI principles
SafetyRobustness & digital securityAccountabilityTransparency & explainabilityHuman wellbeingDemocracy & human autonomyPrivacy & data governanceRespect of human rights

Industries
Mobility and autonomous vehiclesDigital securityRobots, sensors, and IT hardware

Affected stakeholders
ConsumersGeneral public

Harm types
Physical (death)Physical (injury)Economic/PropertyReputationalPublic interest

Business function:
Research and developmentMonitoring and quality controlManufacturing

AI system task:
Recognition/object detectionGoal-driven organisationEvent/anomaly detection


Articles about this incident or hazard