AI Facial Recognition Error Leads to Wrongful Arrests in the US

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

At least eight Americans were wrongfully arrested due to misidentification by AI facial recognition software, as reported by the Washington Post. The police relied solely on AI without verifying alibis or other evidence, leading to potential human rights violations. The full extent of such incidents remains unknown due to limited disclosure requirements.[AI generated]

Why's our monitor labelling this an incident or hazard?

Facial recognition is an AI system; its errors directly caused the police to detain innocent people, constituting realized harm (wrongful arrests, violation of human rights). This is a clear AI Incident.[AI generated]
AI principles
AccountabilityFairnessPrivacy & data governanceRespect of human rightsRobustness & digital securitySafetyTransparency & explainabilityDemocracy & human autonomyHuman wellbeing
Industries
Government, security, and defenceDigital security
Affected stakeholders
General public
Harm types
Human or fundamental rightsPsychologicalReputationalEconomic/PropertyPublic interest
Business function:
Compliance and justice
AI system task:
Recognition/object detection
In other databases
Open in  AIID Logo

Articles about this incident or hazard

2025-01-15
光明网