Facial Recognition AI in Policing Leads to False Identifications and Racial Bias Concerns

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Police use of AI-powered facial recognition technology has resulted in false identifications and disproportionately targeted non-white individuals, raising concerns about bias and rights violations. Despite limited success, authorities in New Orleans and the UK are expanding its use, prompting criticism from lawmakers and civil rights advocates over privacy and civil liberties.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly involves an AI system—facial recognition technology—used by law enforcement. The use of this AI system has directly led to harms: racial bias against Black individuals and ineffective policing outcomes, including false matches and wrongful targeting. These harms fall under violations of human rights and harm to communities. The article provides data showing the system's failures and biased application, confirming realized harm rather than potential harm. Therefore, this event qualifies as an AI Incident.[AI generated]
AI principles
FairnessPrivacy & data governanceRespect of human rightsTransparency & explainabilityAccountabilityRobustness & digital securitySafetyDemocracy & human autonomy

Industries
Government, security, and defence

Affected stakeholders
General public

Harm types
Human or fundamental rightsPsychologicalReputationalPublic interest

Business function:
Compliance and justice

AI system task:
Recognition/object detection


Articles about this incident or hazard