Tesla AI Sensor Malfunctions Cause Phantom Pedestrian and Vehicle Detections

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Multiple Tesla drivers reported that their vehicles' AI-powered sensors falsely detected pedestrians and vehicles in empty environments, such as graveyards and tunnels. These malfunctions, attributed to sensor or algorithm errors, did not cause harm but raise safety concerns about potential risks if the vehicle or driver reacts to nonexistent obstacles.[AI generated]

Why's our monitor labelling this an incident or hazard?

The Tesla vehicle uses AI systems (cameras and sensors with AI perception) to detect surroundings including pedestrians. The false detection of many pedestrians where none exist is a malfunction of the AI system. Although the driver was scared, no actual harm or accident occurred. This is a malfunction event with potential safety implications but no realized harm. Therefore, it qualifies as an AI Hazard because the malfunction could plausibly lead to harm in the future if it causes driver distraction or inappropriate reactions, but no harm has yet occurred.[AI generated]
AI principles
SafetyRobustness & digital securityAccountability

Industries
Mobility and autonomous vehicles

Severity
AI hazard

Business function:
Other

AI system task:
Recognition/object detection


Articles about this incident or hazard