UnitedHealth Accused of Using Faulty AI to Deny Elderly Patients Care

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

UnitedHealth Group faces lawsuits alleging it used an AI algorithm, nH Predict, to systematically deny necessary rehabilitative care to Medicare Advantage patients. Staff were pressured to follow the AI's error-prone recommendations over doctors' advice, resulting in denied claims, financial hardship, and potential harm to elderly and disabled patients.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves an AI system (an algorithm predicting rehab stay length) whose use directly led to harm: denial of medically justified rehabilitation care to older and disabled patients, which constitutes harm to health and a violation of patients' rights. The algorithm's role was pivotal in causing this harm through enforced adherence to its predictions, making this an AI Incident.[AI generated]
AI principles
AccountabilityFairnessHuman wellbeingRespect of human rightsRobustness & digital securitySafetyTransparency & explainabilityDemocracy & human autonomy

Industries
Healthcare, drugs, and biotechnologyFinancial and insurance services

Affected stakeholders
Consumers

Harm types
Physical (injury)Economic/PropertyPsychologicalReputationalHuman or fundamental rights

Business function:
Citizen/customer serviceMonitoring and quality control

AI system task:
Organisation/recommendersForecasting/prediction

In other databases

Articles about this incident or hazard