Google AI Overviews put people at risk of harm with misleading health advice
2026-01-02
the Guardian
The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
Google's AI Overviews, which generate health information summaries atop search results, have provided inaccurate and misleading medical advice, including dangerous recommendations for cancer and liver disease patients. Experts warn these errors could worsen health outcomes or increase mortality, directly putting users at risk of harm.[AI generated]
Why's our monitor labelling this an incident or hazard?
The article explicitly involves an AI system (Google's AI Overviews) that generates health information summaries. The inaccuracies in these AI-generated summaries have directly led to misinformation that experts warn could cause physical harm or worsen health outcomes, such as jeopardizing cancer treatment or misinforming about liver disease. This constitutes direct harm to people's health caused by the AI system's outputs. Therefore, this event qualifies as an AI Incident rather than a hazard or complementary information, as the harm is realized and ongoing.[AI generated]