Tesla Software Update Traps User in Car During Extreme Heat

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

TikToker Brianna Janel was trapped inside her Tesla during a software update, unable to open doors or windows as temperatures reached up to 46°C. The AI-driven update process locked her in, causing significant distress and heat exposure, highlighting safety risks in Tesla's software management system.[AI generated]

Why's our monitor labelling this an incident or hazard?

Tesla vehicles incorporate AI systems for autonomous driving and software management. The software update process locked the user inside the vehicle, preventing escape and causing exposure to extreme heat, which is a direct harm to the user's health. The AI system's malfunction or design in handling the update and locking mechanism contributed to this harm. Therefore, this event qualifies as an AI Incident due to the realized harm (or significant risk thereof) caused by the AI system's operation during the software update.[AI generated]
AI principles
SafetyRobustness & digital securityTransparency & explainabilityAccountabilityHuman wellbeingDemocracy & human autonomy

Industries
Mobility and autonomous vehiclesIT infrastructure and hosting

Affected stakeholders
Consumers

Harm types
Physical (injury)Psychological

Business function:
ICT management and information securityMaintenance

AI system task:
Other


Articles about this incident or hazard