The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
A BMW Toronto dealership's AI chatbot, 'Quinn,' mistakenly offered a customer an inflated buy-back price for his car, matching his loan balance. The dealership initially revoked the offer, causing financial and emotional harm, but later honored it after media scrutiny. The incident raises concerns about AI accountability in customer interactions.[AI generated]
Why's our monitor labelling this an incident or hazard?
An AI system (the chatbot) was used in the negotiation process and malfunctioned by offering an incorrect trade-in price. This malfunction directly caused harm to the customer, including financial and emotional harm due to misleading information and breach of trust. The dealership's response to honor the offer does not negate the fact that the AI system's malfunction led to harm. Therefore, this qualifies as an AI Incident because the AI system's malfunction directly led to harm to a person (the customer).[AI generated]