AI Symptom Checkers Frequently Misdiagnose Skin Rashes

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A Mayo Clinic study found that AI-powered online symptom checkers correctly diagnosed skin rashes in only 30.8% of cases, highlighting significant inaccuracy. This raises concerns about potential health risks if users rely on these AI systems for medical decisions due to their frequent misdiagnoses.[AI generated]

Why's our monitor labelling this an incident or hazard?

Online symptom checkers are AI systems that process user input to generate medical diagnoses. The study shows these systems have poor accuracy in diagnosing skin rashes, which can lead to harm if users rely on incorrect information for health decisions. This constitutes an AI Incident because the AI system's use has directly led to potential harm to health by providing inaccurate medical advice.[AI generated]
AI principles
SafetyRobustness & digital securityHuman wellbeing

Industries
Healthcare, drugs, and biotechnology

Affected stakeholders
Consumers

Harm types
Physical (injury)

Severity
AI incident

AI system task:
Organisation/recommenders


Articles about this incident or hazard

Thumbnail Image

Online Symptom Checkers Often Not Accurate for ID'ing Skin Rashes

2022-10-18
Consumer Health News | HealthDay
Why's our monitor labelling this an incident or hazard?
Online symptom checkers are AI systems that process user input to generate medical diagnoses. The study shows these systems have poor accuracy in diagnosing skin rashes, which can lead to harm if users rely on incorrect information for health decisions. This constitutes an AI Incident because the AI system's use has directly led to potential harm to health by providing inaccurate medical advice.
Thumbnail Image

Online Symptom Checkers Often Not Accurate for ID'ing Skin Rashes

2022-10-18
pantagraph.com
Why's our monitor labelling this an incident or hazard?
The symptom checkers described are AI systems that analyze user input to generate diagnostic outputs. The study highlights their poor accuracy, which is a malfunction or limitation in their use. However, the article does not report any direct or indirect harm resulting from these inaccuracies, such as injury, health harm, or rights violations. It merely presents research findings on their performance. Therefore, this is complementary information providing context and assessment of AI system capabilities rather than an incident or hazard involving realized or plausible harm.
Thumbnail Image

Online Symptom Checkers Often Not Accurate for ID'ing Skin Rashes

2022-10-19
Napa Valley Register
Why's our monitor labelling this an incident or hazard?
The article involves AI systems (online symptom checkers) used for diagnosis, which fits the definition of AI systems. However, the article only reports on their poor accuracy and limitations without describing any actual harm (such as misdiagnosis leading to injury or health harm) or disruption. There is no indication that harm has occurred or that a specific incident took place. The article is primarily reporting research findings about AI system performance, which is informative but does not meet the threshold for an AI Incident or AI Hazard. Therefore, it is best classified as Complementary Information, as it provides context and understanding about AI system limitations in healthcare.
Thumbnail Image

Online Symptom Checkers Often Not Accurate for ID'ing Skin Rashes

2022-10-19
Sioux City Journal
Why's our monitor labelling this an incident or hazard?
The online symptom checkers are AI systems designed to diagnose medical conditions based on user input. The study shows these systems frequently misdiagnose skin rashes, which can lead to harm to patients' health (harm category a). The harm is indirect, as the AI system's inaccurate diagnosis could cause inappropriate medical decisions. Hence, this qualifies as an AI Incident due to realized harm linked to the AI system's use.
Thumbnail Image

Online Symptom Checkers Often Not Accurate for ID'ing Skin Rashes

2022-10-19
Muscatine Journal
Why's our monitor labelling this an incident or hazard?
The online symptom checkers are AI systems used for medical diagnosis. The study shows their inaccuracy, which implies a potential risk of misdiagnosis and consequent harm if users rely on them. However, the article does not report any actual harm, injury, or violation resulting from their use. It is an evaluation of AI system performance highlighting limitations and risks but without evidence of realized harm or incident. Hence, it fits best as Complementary Information, providing context and understanding about AI system capabilities and limitations in healthcare diagnostics.
Thumbnail Image

Online Symptom Checkers Often Not Accurate for ID'ing Skin Rashes

2022-10-19
Courier-Tribune
Why's our monitor labelling this an incident or hazard?
Online symptom checkers use AI systems to analyze user input and provide diagnostic suggestions. The study shows these AI systems often produce inaccurate diagnoses, which can lead to harm if users rely on incorrect information for medical decisions. Since the AI systems' use has directly led to inaccurate diagnoses, which is a form of harm to health, this qualifies as an AI Incident.