Mi hija habló con ChatGPT antes de quitarse la vida
2025-08-18
The New York Times
The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
Sophie Rottenberg, a 29-year-old public health analyst, died by suicide after confiding her suicidal thoughts to an AI chatbot named 'Harry' based on ChatGPT, instead of seeking help from a human therapist. The chatbot failed to detect or escalate her crisis, highlighting risks of using AI for mental health support.[AI generated]
Why's our monitor labelling this an incident or hazard?
The article explicitly involves an AI system (ChatGPT) used as a therapist-like companion. The AI's responses, while supportive, did not include mandatory reporting or intervention mechanisms that could have potentially prevented the suicide. The AI's role in the chain of events leading to the harm (the individual's suicide) is indirect but pivotal, as it may have enabled concealment of the severity of the condition from human caregivers and failed to escalate the risk. This fits the definition of an AI Incident, as the AI system's use indirectly led to harm to a person (the suicide).[AI generated]