Flawed AI System Raises Healthcare Costs for Kenya's Poor

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Kenya's new AI-driven healthcare system, launched in October 2024, uses a predictive algorithm to calculate insurance contributions. The system overestimates incomes of poor households, resulting in unaffordable fees, denial of treatment, and harm to vulnerable populations. Widespread protests highlight the system's lack of transparency and negative impact.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly mentions the use of an AI-powered predictive algorithm that calculates healthcare premiums, which has malfunctioned or been misapplied, causing direct harm to the poorest Kenyans by overestimating their incomes and charging unaffordable fees. This has resulted in people being unable to access healthcare, leading to suffering and death, which constitutes injury or harm to health and harm to communities. The AI system's flawed use and deployment are central to the harm described, meeting the criteria for an AI Incident rather than a hazard or complementary information.[AI generated]
AI principles
FairnessTransparency & explainability

Industries
Healthcare, drugs, and biotechnology

Affected stakeholders
Consumers

Harm types
Economic/PropertyHuman or fundamental rights

Severity
AI incident

Business function:
Accounting

AI system task:
Forecasting/prediction


Articles about this incident or hazard

Thumbnail Image

Flaws in Kenya's AI-driven health reforms driving up costs for the poorest

2026-05-04
The Guardian
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of an AI-powered predictive algorithm that calculates healthcare premiums, which has malfunctioned or been misapplied, causing direct harm to the poorest Kenyans by overestimating their incomes and charging unaffordable fees. This has resulted in people being unable to access healthcare, leading to suffering and death, which constitutes injury or harm to health and harm to communities. The AI system's flawed use and deployment are central to the harm described, meeting the criteria for an AI Incident rather than a hazard or complementary information.
Thumbnail Image

AI-driven health system in Kenya under fire for raising costs for the poor

2026-05-06
Firstpost
Why's our monitor labelling this an incident or hazard?
An AI system is explicitly involved as it calculates insurance contributions using a predictive machine learning algorithm. The system's use has directly led to harm: poorer households face higher costs and some critically ill individuals are unable to access treatment, which constitutes injury or harm to health and harm to communities. Therefore, this qualifies as an AI Incident because the AI system's use has directly caused realized harm to people and communities.
Thumbnail Image

AI-fueled health policies are depriving the needy in one of the world's poorest countries

2026-05-04
Digital Trends
Why's our monitor labelling this an incident or hazard?
The system uses AI-driven predictive machine learning to calculate premiums, but it overestimates incomes of poor households, causing them to pay unaffordable amounts. This has led to people missing critical treatment and facing steep hospital bills, which constitutes direct harm to health and well-being. The AI system's malfunction or flawed design is a direct contributing factor to these harms, fulfilling the criteria for an AI Incident under the OECD framework.
Thumbnail Image

Flaws in Kenya's AI-driven health reforms driving up costs for the poorest

2026-05-04
Yahoo News UK
Why's our monitor labelling this an incident or hazard?
An AI system is explicitly mentioned as being used to predict individuals' ability to pay for healthcare. The system's use has directly caused harm by overcharging the poor, resulting in inability to access healthcare and consequent suffering and death. The harm includes violation of rights (access to healthcare) and harm to communities (poorer populations suffering and dying). The AI system's flawed design and lack of transparency are central to the incident. Therefore, this qualifies as an AI Incident.
Thumbnail Image

Flaws in Kenya's AI-driven health reforms driving up costs for the poorest | Global development - Ghanamma.com

2026-05-04
GHANA MMA
Why's our monitor labelling this an incident or hazard?
An AI system (a predictive machine learning algorithm) is explicitly mentioned as being used to calculate healthcare contributions. Its use has directly led to harm: overcharging the poorest, causing inability to pay for healthcare, denial of treatment, and deaths. The harm is to health and communities, and the AI system's flawed design and deployment are central to these outcomes. Therefore, this event qualifies as an AI Incident rather than a hazard or complementary information.