Oregon Sues OpenAI Over ChatGPT's Alleged Harm to Children

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Oregon Attorney General Dan Rayfield filed a $2 billion lawsuit against OpenAI, alleging its ChatGPT chatbot endangers children by exposing them to harmful content and encouraging dangerous behaviors. The suit claims OpenAI misled the public about product safety and failed to address these risks, prompting legal action.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event explicitly involves an AI system, ChatGPT, and alleges that its use has caused harm to children by exposing them to harmful advice and emotional risks, which are health-related harms. The lawsuit accuses OpenAI of knowingly designing the system in a way that puts children at risk and misleading parents, indicating direct or indirect causation of harm. The harms described include injury to health (mental health issues) and violations of consumer protection laws. The presence of a legal complaint and detailed allegations of harm confirm that this is not merely a potential risk but an incident with realized harm. Hence, the classification as an AI Incident is appropriate.[AI generated]
AI principles
SafetyTransparency & explainability

Industries
Consumer services

Affected stakeholders
Children

Harm types
PsychologicalPhysical (injury)

AI system task:
Interaction support/chatbotsContent generation


Articles about this incident or hazard