Tesla Autopilot AI Failures Lead to Accidents and Regulatory Scrutiny in the US

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

The US National Highway Traffic Safety Administration (NHTSA) is investigating Tesla's Autopilot and Full Self-Driving AI systems after multiple accidents, including fatalities, where the AI failed to detect emergency vehicles. Tesla faces criticism for not issuing recalls and for restricting negative feedback from users, raising safety and compliance concerns.[AI generated]

Why's our monitor labelling this an incident or hazard?

Tesla's Autopilot and Full Self-Driving systems are AI-based driver assistance technologies. The NHTSA's investigation is prompted by a series of accidents involving these systems, indicating realized harm or risk thereof. The confidentiality agreements limiting negative feedback reporting hinder safety oversight, which is a misuse or problematic use of the AI system. The failure to issue a recall after identifying a safety-related software defect further implicates the AI system's use in potential harm. Therefore, the event involves the use and possible malfunction or misuse of AI systems leading to or associated with harm, qualifying it as an AI Incident.[AI generated]
AI principles
AccountabilitySafetyRobustness & digital securityTransparency & explainability

Industries
Mobility and autonomous vehicles

Affected stakeholders
ConsumersGeneral public

Harm types
Physical (death)Physical (injury)

Business function:
Research and development

AI system task:
Recognition/object detectionGoal-driven organisation


Articles about this incident or hazard