FSD Tries to Drive Straight Into Lake
2026-02-17
Futurism
The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
Daniel Milligan, a former SpaceX engineer, reported and shared video evidence of his Tesla's Full Self-Driving (FSD) system attempting to drive into a lake. The incident, which required driver intervention to prevent harm, highlights ongoing safety concerns and reliability issues with Tesla's AI-powered autonomous driving technology.[AI generated]
Why's our monitor labelling this an incident or hazard?
The event involves an AI system explicitly mentioned as Tesla's Full Self-Driving software, which malfunctioned by misinterpreting the environment and attempting to steer the car into a lake. The driver had to intervene to prevent harm, indicating the AI system's failure to safely perform its intended function. This malfunction directly led to a hazardous situation with potential injury and property damage, fitting the definition of an AI Incident. The incident is not merely a potential risk or a general update but a concrete event where the AI system's malfunction caused a dangerous outcome requiring human intervention.[AI generated]