The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
Amazon hosted bizarre AI-generated product listings using OpenAI refusal messages (e.g., “I’m sorry but I cannot fulfill this request…”), confusing shoppers and undermining trust. The retailer has removed the misleading titles and said it is enhancing its review systems to block similar AI-created spam.[AI generated]
Why's our monitor labelling this an incident or hazard?
The event involves the use of an AI system (OpenAI's chatbot) to generate product descriptions and titles that are inappropriate or nonsensical, leading to misleading product listings on Amazon. This misuse or failure to properly review AI-generated content has directly led to harm in the form of misinformation and disruption of the consumer shopping experience, which can be considered harm to communities and consumers. Therefore, this qualifies as an AI Incident due to the realized harm caused by the AI system's outputs in a commercial context.[AI generated]
