Google Shuts Down AI Health Advice Feature Amid Safety Concerns

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Google discontinued its AI-powered 'What People Suggest' feature, which aggregated crowdsourced health advice, after criticism over inaccurate and potentially harmful medical guidance. The shutdown reflects growing concerns about AI's role in disseminating unreliable health information to users worldwide.[AI generated]

Why's our monitor labelling this an incident or hazard?

The AI system in question was used to collate and present health advice from online forums, which inherently carries risks of misinformation. The article references previous incidents where Google's AI-generated medical summaries contained incorrect and potentially dangerous advice, indicating realized harm or at least significant risk to users' health. The removal of the tool, despite official statements, suggests recognition of these risks. Given the AI system's role in providing medical advice that could harm users, this qualifies as an AI Incident under the framework, as it involves harm to health caused directly or indirectly by the AI system's outputs.[AI generated]
AI principles
SafetyAccountability

Industries
Healthcare, drugs, and biotechnology

Affected stakeholders
Consumers

Harm types
Physical (injury)

Business function:
Other

AI system task:
Organisation/recommendersContent generation


Articles about this incident or hazard