Tesla Sued After Toddler Starts Model X, Injures Pregnant Mother Due to Alleged AI Design Flaw

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Mallory Harcourt sued Tesla after her two-year-old son was able to start their Model X, causing it to hit her and result in serious injuries and premature birth. The lawsuit alleges a design flaw in Tesla's AI-driven control system allowed the incident, raising concerns about inadequate safety features.[AI generated]

Why's our monitor labelling this an incident or hazard?

The Tesla Model X uses AI-based control systems for vehicle operation. The incident resulted in serious injury due to the toddler's ability to start and drive the vehicle, which is linked to alleged design faults in the AI-driven control system. This constitutes direct harm caused by the AI system's malfunction or inadequate safety design, fitting the definition of an AI Incident.[AI generated]
AI principles
SafetyRobustness & digital securityAccountabilityTransparency & explainabilityHuman wellbeing

Industries
Mobility and autonomous vehiclesConsumer productsHealthcare, drugs, and biotechnology

Affected stakeholders
ConsumersWomen

Harm types
Physical (injury)PsychologicalEconomic/PropertyReputational

Business function:
ManufacturingMonitoring and quality controlResearch and development

AI system task:
Recognition/object detectionGoal-driven organisation


Articles about this incident or hazard