AI Prognosis Deepens Emotional Distress for Cancer Patient

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Argentinian influencer Caro Trippar, diagnosed with incurable metastatic cancer, used an AI system to estimate her life expectancy after her doctor declined to provide specifics. The AI's prognosis caused her significant emotional distress, highlighting the psychological harm that can result from AI-generated medical information. The incident occurred in Argentina.[AI generated]

Why's our monitor labelling this an incident or hazard?

An AI system was explicitly used by the individual to analyze medical data and provide a prognosis. The AI's response deepened the user's anguish, causing psychological harm. This is a direct harm to the health of a person caused by the use of an AI system. Therefore, this event qualifies as an AI Incident under the framework's criteria for harm to health resulting from AI use.[AI generated]
AI principles
SafetyHuman wellbeing

Industries
Healthcare, drugs, and biotechnology

Affected stakeholders
Consumers

Harm types
Psychological

AI system task:
Forecasting/prediction


Articles about this incident or hazard