
The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
Dutch health insurer Zilveren Kruis financially pressures general practitioners to adopt AI-based triage apps, despite doctors' concerns about their medical safety and regulatory compliance. Refusal results in significant financial penalties, raising risks of incorrect medical advice and potential harm to patients, especially vulnerable groups.[AI generated]
Why's our monitor labelling this an incident or hazard?
The article describes AI-based triage apps that advise patients on medical appointments, which qualifies as AI systems. The financial coercion by the insurer to use these apps despite their questionable medical validity and regulatory compliance creates a credible risk of harm to patients, especially vulnerable populations who may misunderstand or misuse the app. No actual harm or incidents are reported, but the plausible future harm from reliance on these apps is clear. Hence, this is an AI Hazard rather than an AI Incident. The article also discusses governance and policy context but focuses mainly on the risk posed by enforced use of these AI systems.[AI generated]