Hikers Stranded on Unnecessary Mountain After Relying on ChatGPT

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Two hikers in Canada near Vancouver followed a ChatGPT-planned route, ignoring weather conditions, and became stranded on Unnecessary Mountain. Their reliance on AI advice left them ill-equipped for snowy trails, necessitating a rescue operation by local search and rescue teams.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves the use of an AI system (ChatGPT) to plan a hiking route. The AI system's output was inaccurate or insufficiently detailed, leading the hikers to be ill-prepared and stranded in hazardous conditions. This directly caused harm to the hikers' safety and required a rescue operation, fulfilling the criteria for an AI Incident. The harm is realized, not just potential, and the AI system's role is pivotal in the chain of events. Therefore, this is classified as an AI Incident.[AI generated]
AI principles
SafetyTransparency & explainabilityAccountabilityHuman wellbeingDemocracy & human autonomy

Industries
Travel, leisure, and hospitalityGovernment, security, and defence

Affected stakeholders
Consumers

Harm types
Physical (injury)PsychologicalEconomic/Property

Severity
AI incident

AI system task:
Interaction support/chatbotsContent generationReasoning with knowledge structures/planning


Articles about this incident or hazard