AI Recruitment Error Sends Untrained ICE Agents Into the Field

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A malfunctioning AI system used by U.S. Immigration and Customs Enforcement (ICE) misclassified applicants' résumés, allowing unqualified recruits to bypass essential training and be deployed as law enforcement officers. The error, driven by keyword matching, led to operational risks and public safety concerns as undertrained agents entered the field.[AI generated]

Why's our monitor labelling this an incident or hazard?

An AI system was explicitly used to scan résumés and classify applicants for training. The malfunction led to unprepared agents being deployed, which constitutes harm to the health and safety of people (the agents themselves and potentially the public they interact with). The AI system's malfunction directly caused this harm by misclassifying applicants and enabling improper training and deployment. Therefore, this qualifies as an AI Incident.[AI generated]
AI principles
AccountabilityFairnessSafetyRobustness & digital securityTransparency & explainabilityRespect of human rights

Industries
Government, security, and defence

Affected stakeholders
General public

Harm types
Public interest

Business function:
Human resource management

AI system task:
Organisation/recommenders

In other databases

Articles about this incident or hazard