
The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
Utah launched an AI chatbot, Doctronic, to automate prescription refills, bypassing doctor visits. The program has raised significant concerns among medical professionals about patient safety, potential drug interactions, and regulatory oversight, as the AI system assumes tasks traditionally reserved for licensed physicians.[AI generated]
Why's our monitor labelling this an incident or hazard?
The AI system Doctronic is explicitly described as autonomously renewing prescriptions, a medical decision traditionally reserved for licensed human physicians. The article details concerns about patient safety risks, including the possibility of harmful side effects or drug interactions from automatic refills without proper medical oversight. The involvement of the AI system in medical decision-making and the documented concerns from medical boards and experts about risks to patient health demonstrate that the AI's use has already led to or is causing harm or significant risk of harm. This meets the definition of an AI Incident, as the AI system's use has directly or indirectly led to harm to people's health. The event is not merely a potential hazard or complementary information but an ongoing incident with real-world implications.[AI generated]