Flawed Universal Credit Algorithm Pushes UK Claimants into Poverty

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A poorly designed algorithm automating the UK's Universal Credit benefits system has caused significant harm, including hunger, debt, and psychological distress among claimants. Human Rights Watch reports the system's payment miscalculations and inflexibility are pushing vulnerable people into poverty, calling for urgent redesign to protect social security rights.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly mentions an algorithm that determines welfare payments, which qualifies as an AI system involved in decision-making affecting individuals' financial support. The flawed design of this AI system has directly led to harm to people by pushing them into poverty-related conditions, fulfilling the criteria for an AI Incident. The harm includes violation of social and economic rights and significant negative impacts on individuals' well-being. Therefore, this event is best classified as an AI Incident.[AI generated]
AI principles
FairnessRespect of human rightsHuman wellbeingAccountabilityTransparency & explainabilityRobustness & digital securitySafety

Industries
Government, security, and defence

Affected stakeholders
Consumers

Harm types
Economic/PropertyPsychologicalHuman or fundamental rights

Business function:
Citizen/customer service

AI system task:
Goal-driven organisation


Articles about this incident or hazard