Judge Criticizes AI-Generated Immigration Use-of-Force Reports for Inaccuracy

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

U.S. District Judge Sara Ellis criticized immigration agents in Chicago for using ChatGPT to generate use-of-force reports, highlighting factual inaccuracies and privacy concerns. The AI-generated reports undermined law enforcement credibility and raised public trust issues during an immigration crackdown and related protests.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly mentions the use of an AI system (ChatGPT) by immigration agents to write use-of-force reports. The judge's footnote highlights that this practice has led to inaccuracies in the reports, which undermines the credibility of the agents and could harm public trust. This is a direct consequence of the AI system's use, fulfilling the criteria for an AI Incident as it has directly led to harm in terms of misinformation and potential violation of rights related to fair and accurate reporting.[AI generated]
AI principles
AccountabilityPrivacy & data governanceRobustness & digital securityTransparency & explainabilityRespect of human rightsDemocracy & human autonomy

Industries
Government, security, and defence

Affected stakeholders
GovernmentGeneral public

Harm types
ReputationalPublic interestHuman or fundamental rights

Business function:
Compliance and justice

AI system task:
Content generation


Articles about this incident or hazard