Google Maps AI Error Endangers Hiker on Mount Fromme

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A hiker became stranded on Mount Fromme after following a non-existent trail recommended by Google Maps, which uses AI for mapping. The error led to a dangerous rescue operation by North Shore Rescue. The incident highlights the risks of relying on AI-generated navigation in wilderness areas.[AI generated]

Why's our monitor labelling this an incident or hazard?

Google Maps uses AI systems for mapping and route recommendations. The incorrect display of a non-existent trail on Google Maps led hikers to dangerous areas, resulting in multiple rescue operations and at least one fatality in the past. The AI system's erroneous output indirectly caused harm by misleading users into unsafe terrain. The involvement of the AI system in the harm is clear and direct, fulfilling the criteria for an AI Incident under the framework.[AI generated]
AI principles
SafetyRobustness & digital securityAccountabilityTransparency & explainabilityHuman wellbeing
Industries
Mobility and autonomous vehiclesTravel, leisure, and hospitalityConsumer services
Affected stakeholders
ConsumersWorkers
Harm types
Physical (injury)Economic/PropertyReputational
AI system task:
Organisation/recommendersRecognition/object detection

Articles about this incident or hazard