AI-Generated Travel Advice Sends Tourists to Non-Existent and Dangerous Destinations in Peru

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Travelers using AI tools like ChatGPT for trip planning have been misled to non-existent destinations, such as the fabricated 'Sacred Canyon of Humantay' in Peru. This misinformation has resulted in tourists being stranded in remote areas, facing financial loss and potential physical danger due to hazardous conditions.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly involves AI systems (ChatGPT and similar large language models) used for travel planning. The AI's outputs included fabricated locations ('Sacred Canyon of Humantay') that do not exist, causing tourists to end up in unsafe or meaningless places, incurring financial loss and risking physical harm due to environmental dangers like high altitude without proper preparation. This constitutes direct harm to people (harm to health and safety) caused by the AI system's use and its hallucinations. Therefore, this qualifies as an AI Incident rather than a hazard or complementary information.[AI generated]
AI principles
AccountabilityTransparency & explainabilityRobustness & digital securitySafetyHuman wellbeing

Industries
Travel, leisure, and hospitality

Affected stakeholders
Consumers

Harm types
Physical (injury)Economic/Property

Severity
AI incident

AI system task:
Content generation


Articles about this incident or hazard