AI Chatbots Linked to Mental Health Harms Among Minors, Prompting Industry Response

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

AI chatbots like ChatGPT and Character.ai have been linked to serious mental health harms among minors, including a suicide. In response, Character.ai is restricting access for users under 18, while OpenAI is enhancing ChatGPT's safety features and parental controls. U.S. regulators are also considering new legislation.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves AI chatbots (AI systems) whose use has directly led to serious mental health harms among minors, including a suicide. Character.ai's new measures are a response to these harms. Since the AI systems' use has caused actual harm to users' health (mental health of minors), this qualifies as an AI Incident. The article focuses on the harms caused and the responses to them, not just potential risks or general AI news.[AI generated]
AI principles
SafetyHuman wellbeingAccountability

Industries
Consumer servicesMedia, social platforms, and marketing

Affected stakeholders
Children

Harm types
Physical (death)Psychological

Severity
AI incident

Business function:
Other

AI system task:
Interaction support/chatbotsContent generation


Articles about this incident or hazard

Thumbnail Image

Character.AI acaba de enseñarle a ChatGPT el camino para atajar el problema de la IA y los menores de edad

2025-10-31
Xataka
Why's our monitor labelling this an incident or hazard?
The event involves AI chatbots (AI systems) whose use has directly led to serious mental health harms among minors, including a suicide. Character.ai's new measures are a response to these harms. Since the AI systems' use has caused actual harm to users' health (mental health of minors), this qualifies as an AI Incident. The article focuses on the harms caused and the responses to them, not just potential risks or general AI news.
Thumbnail Image

El alarmante estudio de Open AI sobre los signos de crisis psicótica de miles de usuarios de ChatGPT

2025-10-31
La Voz
Why's our monitor labelling this an incident or hazard?
The event explicitly involves an AI system (ChatGPT) whose use has been linked to serious mental health harms, including hospitalizations and deaths, which constitute injury or harm to persons. The study and reported outcomes indicate that the AI's outputs or interactions have directly or indirectly contributed to these harms. Therefore, this qualifies as an AI Incident under the definition of harm to health caused by the use of an AI system. The ongoing efforts to improve the system are complementary but do not negate the incident classification.
Thumbnail Image

El CEO de OpenAI advierte: no compartas datos personales con ChatGPT

2025-10-31
LaSexta
Why's our monitor labelling this an incident or hazard?
The article involves an AI system (ChatGPT) and addresses the potential for harm related to privacy and legal exposure of user data. While no direct harm or incident is reported, the discussion centers on plausible future harms stemming from the use of AI without adequate privacy protections. Therefore, it fits the definition of an AI Hazard, as it plausibly could lead to violations of rights or other harms if unaddressed.
Thumbnail Image

ChatGPT mejora su respuesta ante crisis de salud mental con actualización GPT-5

2025-10-31
Montevideo Portal / Montevideo COMM
Why's our monitor labelling this an incident or hazard?
The event involves the use and development of an AI system (GPT-5) designed to interact with users in mental health contexts. The improvements are intended to reduce potential harm, such as inappropriate responses or emotional dependency, which could lead to harm if not addressed. However, the article does not describe any realized harm or incidents caused by the AI system; rather, it focuses on mitigation and safety enhancements. Therefore, this is best classified as Complementary Information, as it provides an update on the AI system's development and safety improvements without reporting a new AI Incident or AI Hazard.
Thumbnail Image

OpenAI revela que más de un millón de usuarios de ChatGPT muestran señales de crisis emocional cada semana

2025-10-31
Urban Tecno
Why's our monitor labelling this an incident or hazard?
The article explicitly involves an AI system (ChatGPT) used by millions, with documented cases of users exhibiting suicidal thoughts and other mental health issues during interactions. The AI's responses can influence users' emotional states, and there is a reported suicide linked to ChatGPT conversations, indicating direct or indirect harm to health. The presence of a lawsuit and regulatory warnings further confirm the seriousness of the harm. Although OpenAI is working to mitigate risks, the harm is ongoing and materialized, meeting the criteria for an AI Incident rather than a hazard or complementary information.
Thumbnail Image

ChatGPT gestiona mejor los problemas de salud mental con la actualización de GPT-5

2025-10-31
Diario Siglo XXI
Why's our monitor labelling this an incident or hazard?
The article focuses on the updated behavior of an AI system (GPT-5) designed to better handle sensitive mental health conversations, reducing harmful or inappropriate responses. While the AI system is involved, the article does not report any actual harm or incidents caused by the AI, nor does it describe a plausible imminent harm event. Instead, it reports on improvements and safety measures implemented to prevent harm. This fits the definition of Complementary Information, as it provides context and updates on AI system behavior and risk mitigation without describing a new AI Incident or AI Hazard.
Thumbnail Image

Character.AI acaba de enseñarle a ChatGPT el camino para atajar el problema de la IA y los menores de edad

2025-10-31
Prensa Mercosur - Imprensa Mercosul El diario online del MERCOSUR
Why's our monitor labelling this an incident or hazard?
The event involves AI systems (chatbots like Character.ai and ChatGPT) whose use has been linked to serious mental health harms among minors, including a suicide. The article describes concrete harms that have occurred and the companies' responses to mitigate these harms. Since the harms are realized and the AI systems' use is directly linked to these harms, this qualifies as an AI Incident. The article primarily reports on the incident and the companies' mitigation measures, but the presence of actual harm (mental health issues and suicide) caused or linked to AI chatbot use is central.
Thumbnail Image

ChatGPT mejora su manejo de salud mental con la nueva actualización de OpenAI | TN8.ni

2025-10-31
TN8 - Noticias de Nicaragua y El Mundo
Why's our monitor labelling this an incident or hazard?
The event involves an AI system (GPT-5) and its use in sensitive mental health contexts, but the article only discusses enhancements to reduce risks and improve safety. There is no indication that harm has occurred or that an incident took place. The content is primarily about OpenAI's response to previously identified issues and their efforts to mitigate risks, which fits the definition of Complementary Information rather than an AI Incident or AI Hazard.