Amazon's AI chatbot, Q, might be in the throes of a mental health crisis
2023-12-02
Business Insider
The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
Amazon's AI chatbot Q experienced severe hallucinations, leading to the leakage of confidential information such as AWS data center locations and internal programs. Employees flagged the incident as critical, prompting urgent engineering response. Despite Amazon's downplaying, the malfunction raised significant privacy and security concerns.[AI generated]
Why's our monitor labelling this an incident or hazard?
The AI system (Amazon's Q chatbot) is explicitly mentioned and is malfunctioning by generating hallucinations and leaking confidential information. These malfunctions have directly led to harmful outcomes or risks, such as bad legal advice that could cause health issues and harmful responses that could compromise customer accounts. The harms fall under injury or harm to persons and harm to property or rights. Hence, the event meets the criteria for an AI Incident.[AI generated]