The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
Tesla's fully autonomous Cybercab, recently offered for personal use in Texas, malfunctioned during rides with Jeremy Clarkson, running red lights, braking unnecessarily, and failing to stop. The AI-driven vehicle, lacking manual controls, created safety hazards and prompted federal safety investigations, highlighting risks associated with unsupervised AI operation.[AI generated]
Why's our monitor labelling this an incident or hazard?
The Tesla Cybercab is an AI system operating autonomously without human intervention (no steering wheel or pedals). The described behavior—running red lights, braking for non-existent obstacles, and failing to stop—represents a malfunction of the AI system controlling the vehicle. This malfunction directly endangered the passenger's safety and caused psychological harm (fear and worry). The event involves the use and malfunction of an AI system leading to realized harm, fitting the definition of an AI Incident. The federal safety probe further supports the seriousness of the incident.[AI generated]