Google Maps and Waze Alter Routes After Tourists Harmed in South Africa

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

AI-powered navigation apps Google Maps and Waze directed tourists through Cape Town’s high-crime Nyanga area, resulting in shootings, robbery, and a fatality. Following these incidents, Google is removing these routes and labeling them as high-risk to prevent further harm, highlighting the risks of AI-driven routing in unsafe regions.[AI generated]

Why's our monitor labelling this an incident or hazard?

Google Maps uses AI algorithms to generate navigation routes. In this case, the AI system's routing led tourists into a violent area where they were attacked, causing injury and death. The AI system's use directly led to harm, fulfilling the criteria for an AI Incident. The removal of the route and addition of alerts are responses to the incident but do not change the classification of the event itself.[AI generated]
AI principles
SafetyRobustness & digital securityTransparency & explainabilityAccountabilityRespect of human rightsHuman wellbeingFairness
Industries
Mobility and autonomous vehiclesTravel, leisure, and hospitalityConsumer services
Affected stakeholders
Consumers
Harm types
Physical (death)Physical (injury)Economic/PropertyPsychological
Business function:
Other
AI system task:
Organisation/recommendersGoal-driven organisationForecasting/prediction

Articles about this incident or hazard