OpenAI Faces Backlash Over ChatGPT 'Adult Mode' Amid Mental Health and Safety Concerns

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

OpenAI's planned 'Adult Mode' for ChatGPT sparked internal debate due to risks of unhealthy emotional attachment and exposure to minors. Advisors warned of potential harm, including suicide linked to AI chatbots. Age-verification failures could let millions of minors access explicit content, prompting OpenAI to delay the feature.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves an AI system (ChatGPT) and its planned feature (adult mode) that could plausibly lead to significant psychological harm, including emotional dependency and suicidal risk, especially among minors who might access the content due to imperfect age verification. While a past AI-related suicide is mentioned, it involved a different AI chatbot (Character.AI), and the adult mode itself has not yet been released or caused harm. Thus, the article describes a credible potential risk (hazard) rather than a realized incident. The concerns about misuse, user harm, and insufficient safeguards align with the definition of an AI Hazard.[AI generated]
AI principles
SafetyHuman wellbeing

Industries
Media, social platforms, and marketing

Affected stakeholders
ChildrenConsumers

Harm types
Physical (death)Psychological

AI system task:
Interaction support/chatbotsContent generation


Articles about this incident or hazard