Flawed AI Algorithm in Jordan's Welfare Program Excludes Needy from Aid

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A World Bank-funded AI algorithm used in Jordan's Takaful cash assistance program has been criticized by Human Rights Watch for errors and discriminatory criteria that exclude many needy individuals from social support. The system's rigid model has led to wrongful denial of aid, harming vulnerable populations and violating their rights.[AI generated]

Why's our monitor labelling this an incident or hazard?

The algorithm is an AI system used to assess socioeconomic status and determine aid eligibility. Its use has directly led to harm by excluding financially strained individuals who do not fit the algorithm's rigid criteria, resulting in violations of rights to social support and harm to communities. Therefore, this qualifies as an AI Incident due to the realized harm caused by the AI system's use.[AI generated]
AI principles
FairnessTransparency & explainabilityAccountabilityRespect of human rightsRobustness & digital security

Industries
Government, security, and defence

Affected stakeholders
General public

Harm types
Economic/PropertyHuman or fundamental rights

Severity
AI incident

Business function:
Citizen/customer service

AI system task:
Forecasting/predictionGoal-driven organisation

In other databases

Articles about this incident or hazard

Thumbnail Image

Rights Group Slams 'Flawed' Aid Algorithm Leaving Needy Jordanians Unassisted - The Media Line

2023-06-13
The Media Line
Why's our monitor labelling this an incident or hazard?
The algorithm is an AI system used to assess socioeconomic status and determine aid eligibility. Its use has directly led to harm by excluding financially strained individuals who do not fit the algorithm's rigid criteria, resulting in violations of rights to social support and harm to communities. Therefore, this qualifies as an AI Incident due to the realized harm caused by the AI system's use.
Thumbnail Image

Rights group: World Bank, Jordan use flawed formula for aid to...

2023-06-13
Daily Mail Online
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions an automated program (algorithm) used for poverty targeting, which is an AI system by definition as it infers socio-economic status from input data to generate decisions affecting aid distribution. The use of this AI system has directly led to harm by excluding needy individuals from aid, thus causing harm to communities and violating their rights to social support. Therefore, this qualifies as an AI Incident because the AI system's use has directly caused harm to people through unfair exclusion from aid.
Thumbnail Image

An Algorithm Aimed To Help Jordan's Poor. It Excluded Some In Need, Report Finds

2023-06-16
Forbes
Why's our monitor labelling this an incident or hazard?
The algorithm is an AI system used to rank households for social assistance based on multiple socio-economic indicators. Its use has directly led to harm by excluding some needy families from receiving aid, as documented by Human Rights Watch through interviews and analysis. The harm is realized and significant, affecting vulnerable populations' access to critical social support, thus fitting the definition of an AI Incident involving violations of rights and harm to communities. The involvement is through the use of the AI system in decision-making that caused exclusion and harm. Therefore, this event qualifies as an AI Incident.
Thumbnail Image

Rights group: World Bank, Jordan use flawed formula for aid to kingdom, excluding some poor people

2023-06-13
Yahoo Sports Canada
Why's our monitor labelling this an incident or hazard?
The algorithm is an AI system used for poverty targeting by ranking families based on socio-economic indicators. Its use has directly led to harm by excluding needy individuals from aid, which constitutes harm to communities and individuals' well-being. The harm is realized, not just potential, as people are currently being denied aid due to the algorithm's outputs. Therefore, this qualifies as an AI Incident under the definition of harm to communities and violation of rights through the AI system's use.
Thumbnail Image

An algorithm intended to reduce poverty in Jordan disqualifies people in need

2023-06-13
MIT Technology Review
Why's our monitor labelling this an incident or hazard?
The Takaful system is an AI system that ranks families for aid based on socioeconomic indicators. Its use has directly led to harm by unfairly disqualifying needy applicants, causing violations of rights to social protection and reinforcing gender-based discrimination. The harm is realized and documented through interviews and reports by Human Rights Watch. Therefore, this qualifies as an AI Incident due to the direct harm caused by the AI system's use in welfare distribution.
Thumbnail Image

Algorithm Used in Jordanian World Bank Aid Program Stiffs the Poorest

2023-06-13
The Intercept
Why's our monitor labelling this an incident or hazard?
The described system is an AI system because it uses an algorithmic decision-making process involving multiple socioeconomic factors to rank applicants and allocate aid. The harm is realized and direct: the poorest people are being unfairly denied aid, which constitutes harm to communities and a violation of rights. The system's malfunction and flawed design have directly led to these harms. Therefore, this qualifies as an AI Incident.
Thumbnail Image

Rights group: World Bank, Jordan use flawed formula for aid to kingdom, excluding some poor people

2023-06-13
Beaumont Enterprise
Why's our monitor labelling this an incident or hazard?
An AI system (the algorithm) is explicitly involved in assessing aid eligibility using socio-economic indicators. The use of this AI system in its current form has directly led to harm in the form of exclusion of some poor people from financial support, which can be considered harm to communities and a violation of social rights. The harm is realized, as people are not receiving aid they need due to the algorithm's rigid model. Therefore, this qualifies as an AI Incident because the AI system's use has directly led to harm to people by denying them aid.
Thumbnail Image

World Bank / Jordan: Poverty Targeting Algorithms Harm Rights

2023-06-13
Human Rights Watch
Why's our monitor labelling this an incident or hazard?
The event involves an AI system explicitly described as an algorithm used to profile and rank households for cash assistance. The use of this AI system has directly led to harm by denying financial support to people who need it, which constitutes a violation of human rights (right to social security). The report details discriminatory policies and errors in the algorithm that cause unfair exclusion and social tension, fulfilling the criteria for an AI Incident. The harm is realized and ongoing, not merely potential, and the AI system's role is pivotal in causing these harms. Therefore, this event qualifies as an AI Incident.
Thumbnail Image

Interview: How Flawed Policies Lead to Flawed Technology

2023-06-13
Human Rights Watch
Why's our monitor labelling this an incident or hazard?
The event involves an AI system (an algorithm using 57 indicators to assess poverty and allocate benefits) whose use has directly led to harm: exclusion of vulnerable people from social benefits, discriminatory impacts (gender and citizenship bias), and inaccurate poverty assessments. These harms affect individuals' right to social security and economic well-being, thus meeting the criteria for an AI Incident. The harm is realized, not just potential, as people are being denied benefits based on flawed AI-driven decisions. Therefore, this is an AI Incident rather than a hazard or complementary information.
Thumbnail Image

Rights group: World Bank, Jordan use flawed formula for aid to kingdom, excluding some poor people - WTOP News

2023-06-13
WTOP
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions an automated program (algorithm) that ranks families' income and socio-economic status to allocate aid. This algorithm's use has directly led to harm by excluding needy people from financial support, thereby increasing poverty and social tension. The harm is a violation of human rights related to access to social support and contributes to harm to communities. Therefore, this qualifies as an AI Incident due to the AI system's use causing realized harm.
Thumbnail Image

'Faulty algorithm' denying welfare support to Jordanians in need

2023-06-13
Middle East Eye
Why's our monitor labelling this an incident or hazard?
The event involves an AI system (the algorithm used in the cash transfer program) whose use has directly led to harm by denying welfare support to needy individuals and families. The harm includes social and economic injury to people who are entitled to support, as well as discriminatory impacts against certain groups (e.g., women married to non-Jordanian men). This fits the definition of an AI Incident because the AI system's use has directly caused violations of rights and harm to communities. The report details realized harm rather than potential harm, so it is not a hazard or complementary information.
Thumbnail Image

World Bank, Jordan use flawed formula for aid to kingdom, excluding some poor people

2023-06-13
The Manila times
Why's our monitor labelling this an incident or hazard?
The event involves an AI system (an automated algorithm using 57 socioeconomic indicators) used to rank families for aid eligibility. The use of this AI system has directly led to harm by excluding some poor and vulnerable people from receiving financial support, which constitutes harm to communities and individuals' well-being. This fits the definition of an AI Incident because the AI system's use has directly caused violations of social and economic rights by denying aid to those in need, thus causing harm to people. Therefore, this event qualifies as an AI Incident.
Thumbnail Image

HRW: Jordan poverty-tackling algorithm plagued with 'errors'

2023-06-13
The New Arab
Why's our monitor labelling this an incident or hazard?
The Takaful program is an AI system used to allocate social benefits based on multiple criteria. HRW's report highlights that the algorithm's errors and discriminatory policies have directly led to people being wrongly denied social security benefits, which is a violation of their rights and causes harm to vulnerable populations. The involvement of the AI system in these harms is explicit and direct, fulfilling the criteria for an AI Incident under violations of human rights and harm to communities. The event is not merely a potential risk or a response update but documents realized harm caused by the AI system's use.