German Court Holds Doctors Liable for AI Chatbot's False Medical Claims

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A German court ruled that doctors operating Aesthetify GmbH are liable for their website's AI chatbot, which falsely claimed they held specialist medical titles. The chatbot's misleading responses led to legal action by a consumer protection group, resulting in a ban on such false statements and a requirement for corrective measures.[AI generated]

Why's our monitor labelling this an incident or hazard?

The chatbot, an AI system, made false claims about specialist medical titles, misleading consumers and constituting unlawful business practices. The court ruling attributes responsibility to the doctors operating the chatbot, confirming the AI system's role in causing harm through misinformation. This meets the criteria for an AI Incident because the AI system's use directly led to a violation of legal obligations and consumer rights. The event is not merely a potential risk or complementary information but a realized harm caused by the AI system's outputs.[AI generated]
AI principles
AccountabilityTransparency & explainability

Industries
Healthcare, drugs, and biotechnology

Affected stakeholders
Consumers

Harm types
ReputationalEconomic/Property

Business function:
Citizen/customer service

AI system task:
Interaction support/chatbots


Articles about this incident or hazard