Faulty AI Facial Recognition Leads to Wrongful Arrest in Detroit

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Detroit police wrongly arrested LaDonna Crutchfield after a facial recognition error misidentified her as a shooting suspect. Despite police claims contesting AI involvement in one instance, a lawsuit argues that reliance on such technology violated her rights and caused significant emotional distress.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event describes a wrongful arrest based on a false facial recognition match, which is an AI system used in law enforcement. The harm includes emotional distress and violation of rights due to misidentification. The AI system's malfunction or misuse directly led to this harm, fulfilling the criteria for an AI Incident. Despite police denial, the lawsuit and pattern of similar cases support the involvement of AI facial recognition causing harm.[AI generated]
AI principles
AccountabilityFairnessHuman wellbeingPrivacy & data governanceRespect of human rightsRobustness & digital securitySafetyTransparency & explainabilityDemocracy & human autonomy
Industries
Government, security, and defenceDigital security
Affected stakeholders
General public
Harm types
Human or fundamental rightsPsychologicalReputational
Business function:
Compliance and justice
AI system task:
Recognition/object detection

Articles about this incident or hazard