AI Chatbots Direct Shoppers to Fake Retail Websites, Study Finds

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A study by IP protection firm Podqi found that AI chatbots ChatGPT, Gemini, and Perplexity frequently recommend fake or risky retail websites when answering shopping queries. Perplexity had the highest rate (15%), followed by ChatGPT (8%) and Gemini (4%), exposing consumers to potential fraud and financial harm.[AI generated]

Why's our monitor labelling this an incident or hazard?

The AI chatbots are explicitly involved as AI systems providing shopping recommendations. Their outputs have directly led to users being exposed to fake websites, which can cause financial harm and fraud, qualifying as injury or harm to persons. The study's findings confirm that this harm is occurring, not just a potential risk. Therefore, this event meets the criteria for an AI Incident due to realized harm caused by the AI systems' use.[AI generated]
AI principles
SafetyAccountability

Industries
Consumer services

Affected stakeholders
Consumers

Harm types
Economic/Property

AI system task:
Organisation/recommendersInteraction support/chatbots


Articles about this incident or hazard