Unapproved Agentic AI Deployment in U.S. Healthcare Raises Patient Safety and Privacy Risks

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Multiple reports reveal that U.S. healthcare organizations are rapidly deploying agentic AI tools—autonomous systems capable of making multi-step decisions—often without formal IT approval or adequate governance. This widespread 'shadow AI' use increases risks of patient safety incidents, privacy breaches, and operational disruptions due to insufficient oversight and identity management.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article discusses the current state and concerns of AI deployment in healthcare, including unapproved use and security gaps, which could plausibly lead to incidents such as data breaches or compliance violations. However, no actual harm or incident is reported. Therefore, this qualifies as an AI Hazard, as the development and use of AI systems in healthcare could plausibly lead to harm, but no specific AI Incident has occurred yet.[AI generated]
AI principles
SafetyPrivacy & data governance

Industries
Healthcare, drugs, and biotechnology

Affected stakeholders
Consumers

Harm types
Physical (injury)Human or fundamental rights

AI system task:
Goal-driven organisation


Articles about this incident or hazard