Palantir AI Use in NHS and Military Sparks Harm and Public Backlash

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Palantir's AI systems, deployed in the UK NHS and by US and Israeli authorities, have led to significant harm: reduced hospital operations in some NHS trusts, mass patient opt-outs due to mistrust, and reported human rights abuses in military and law enforcement contexts. Public protests and political pressure are mounting in response.[AI generated]

Why's our monitor labelling this an incident or hazard?

Palantir's AI system is explicitly mentioned as being used in the NHS federated data platform to improve efficiency and patient outcomes. The controversy and mistrust around Palantir's involvement have caused a rise in patient data opt-outs, directly impacting NHS research and planning capabilities. This is a harm to communities and potentially to health outcomes, fitting the definition of an AI Incident where the AI system's use has directly led to harm. The event does not describe a plausible future harm but an ongoing realized harm. It is not merely complementary information because the main focus is on the harm caused by the AI system's involvement, nor is it unrelated or beneficial use.[AI generated]
AI principles
Respect of human rightsTransparency & explainability

Industries
Healthcare, drugs, and biotechnologyGovernment, security, and defence

Affected stakeholders
ConsumersGeneral public

Harm types
Human or fundamental rightsPublic interestReputational

Business function:
Monitoring and quality control

AI system task:
Goal-driven organisationEvent/anomaly detection


Articles about this incident or hazard