Patients Ignore Medical Advice After Consulting AI Chatbots in Germany

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A Bitkom study reveals that in Germany, 20% of patients have ignored doctors' recommendations after consulting AI chatbots for medical information. Many users trust chatbots more than medical professionals, raising concerns about potential health risks due to overreliance on AI-generated advice.[AI generated]

Why's our monitor labelling this an incident or hazard?

The AI system (chatbot) is explicitly mentioned and is used by patients to obtain medical information. The study reports that some patients trust the AI more than doctors and have even ignored medical advice based on AI consultation, which can directly lead to harm to health. This meets the criteria for an AI Incident because the AI's use has directly led to harm (patients not following medical advice). The event is not merely a potential risk or a complementary update but reports actual behavior with harmful consequences.[AI generated]
AI principles
SafetyTransparency & explainability

Industries
Healthcare, drugs, and biotechnology

Affected stakeholders
Consumers

Harm types
Physical (injury)

AI system task:
Interaction support/chatbotsContent generation


Articles about this incident or hazard