AI-Generated Weight Loss Plan Leads to Severe Health Crisis in Chengdu

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A 34-year-old man in Chengdu used an AI tool to create a high-intensity weight loss plan, resulting in rapid weight loss (40 jin in 45 days) and severe health complications, including multi-organ failure and ICU admission. The AI-generated regimen failed to account for individual health risks, directly causing life-threatening harm.[AI generated]

Why's our monitor labelling this an incident or hazard?

An AI system was used to generate a high-intensity weight loss plan that the individual followed, resulting in severe health harm (multi-organ dysfunction and ICU admission). The AI system's involvement in the development and use of the plan directly led to injury, meeting the criteria for an AI Incident under harm to health. The event is not merely a hazard or complementary information, as the harm has materialized.[AI generated]
AI principles
SafetyRobustness & digital security

Industries
Healthcare, drugs, and biotechnology

Affected stakeholders
Consumers

Harm types
Physical (injury)

AI system task:
Content generation


Articles about this incident or hazard