ChatGPT's Misleading Medical Advice Delays Cancer Diagnosis

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Warren Tierney, a 37-year-old father from Ireland, relied on ChatGPT for medical advice about his sore throat. The AI incorrectly reassured him that cancer was unlikely, leading him to delay seeking professional care. Months later, he was diagnosed with late-stage oesophageal cancer, highlighting the risks of using AI for health decisions.[AI generated]

Why's our monitor labelling this an incident or hazard?

ChatGPT is an AI system providing medical advice. The use of ChatGPT's advice led to a delay in diagnosis of a serious illness, which constitutes indirect harm to health. This fits the definition of an AI Incident because the AI system's use directly contributed to harm to a person's health through misleading advice and delayed medical intervention.[AI generated]
AI principles
SafetyRobustness & digital securityTransparency & explainabilityHuman wellbeing

Industries
Healthcare, drugs, and biotechnology

Affected stakeholders
Consumers

Harm types
Physical (injury)

Severity
AI incident

AI system task:
Interaction support/chatbotsContent generation


Articles about this incident or hazard