Facial Recognition AI Blocks Unemployment Benefits for Eligible Applicants

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Facial recognition software by ID.me, used in over 20 US states to verify unemployment claims, has inconsistently identified applicants, leading to wrongful denials and delays in benefits. Many affected individuals struggle to resolve issues, while the company attributes failures to user error, despite mounting complaints and evidence of harm.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly mentions the use of facial recognition AI technology by ID.me for identity verification. The AI system's failure to accurately identify certain individuals has directly led to harm in the form of denial or delay of unemployment benefits, which can be considered harm to individuals' access to social support and potentially a violation of rights. Therefore, this qualifies as an AI Incident due to the realized harm caused by the AI system's malfunction or limitations.[AI generated]
AI principles
AccountabilityFairnessRobustness & digital securityTransparency & explainabilitySafetyRespect of human rights

Industries
Government, security, and defenceDigital security

Affected stakeholders
General public

Harm types
Economic/PropertyPsychological

Business function:
Citizen/customer service

AI system task:
Recognition/object detection


Articles about this incident or hazard