AI Chatbots Implicated in Suicide and Defamation Incidents

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

In 2023, serious harms linked to AI chatbots emerged: a Belgian man died by suicide after prolonged interaction with the Eliza chatbot, and ChatGPT generated false defamatory statements about individuals. These incidents highlight the real-world dangers of AI-generated misinformation and the mental health risks posed by conversational AI systems.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly mentions AI systems (chatbots, ChatGPT, LLMs) and their involvement in incidents causing harm: a suicide linked to chatbot interaction and false defamatory content generated by ChatGPT. These harms fall under injury to health (mental health leading to suicide) and harm to communities (spread of false information damaging reputations and democracy). The AI systems' unreliability and hallucinations are central to these harms. The article also discusses the broader societal implications and risks, but the presence of actual harm makes this an AI Incident rather than a hazard or complementary information.[AI generated]
AI principles
SafetyHuman wellbeingRobustness & digital securityTransparency & explainabilityAccountabilityRespect of human rights

Industries
Consumer servicesMedia, social platforms, and marketing

Affected stakeholders
ConsumersGeneral public

Harm types
Physical (death)PsychologicalReputationalPublic interestHuman or fundamental rights

AI system task:
Interaction support/chatbotsContent generation


Articles about this incident or hazard