AI-Driven Insurance Claim Denials Lead to Harm and Lawsuits in the US

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

AI systems are increasingly used by US insurers to process and deny claims for medical and property coverage, often without human oversight. This has resulted in wrongful denials, restricted access to care, and even deaths, prompting lawsuits—such as against UnitedHealth Group—and raising regulatory concerns, especially in Florida.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly mentions AI systems used to auto-deny insurance claims rapidly without human oversight, leading to wrongful denials that have been overturned on appeal and, critically, to patient deaths. This constitutes direct harm to health and violations of rights, fulfilling the criteria for an AI Incident. The involvement of AI in the denial decisions and the resulting health consequences are clear and direct, not merely potential or speculative.[AI generated]
AI principles
AccountabilitySafety

Industries
Financial and insurance servicesHealthcare, drugs, and biotechnology

Affected stakeholders
Consumers

Harm types
Physical (death)

Business function:
Accounting

AI system task:
Goal-driven organisation


Articles about this incident or hazard