WHO's new AI-powered chatbot SARAH is giving wrong medical answers - ET CISO
2024-04-19
ETCISO.in
The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
The World Health Organization launched SARAH, an AI-powered chatbot designed to provide global health information. However, SARAH sometimes gives inaccurate or hallucinated answers, potentially spreading health misinformation. WHO acknowledges these flaws, warns users, and limits SARAH's scope, but the risk of public harm remains.[AI generated]
Why's our monitor labelling this an incident or hazard?
The AI system (SARAH) is explicitly mentioned and is in use, providing health information. The chatbot's inaccuracies and hallucinations could plausibly lead to harm such as misinformation affecting public health decisions, which fits the definition of an AI Hazard. There is no evidence in the article that any injury, rights violation, or other harm has actually occurred due to the chatbot's outputs. The article also discusses privacy and security concerns but does not report realized harm. Thus, the event is best classified as an AI Hazard due to the plausible future harm from misinformation and privacy risks associated with the AI system's use.[AI generated]