AI Facial Recognition Error Leads to Wrongful Arrest in UK

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Alvi Choudhury, a Bangladeshi-origin software engineer in Southampton, was wrongfully arrested and detained after UK police facial recognition software misidentified him as a burglary suspect in Milton Keynes. The AI system's false positive, compounded by prior mugshot retention, led to significant distress and raised concerns about racial bias and police reliance on flawed AI.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly describes the use of an AI-powered facial recognition system by UK police that incorrectly matched Alvi Choudhury to a burglary suspect, resulting in his wrongful arrest and custody. The harm is direct and realized: physical and psychological harm from detention, reputational harm affecting his work and security clearance, and a violation of his rights. The AI system's bias and malfunction (false positive) are central to the incident. Therefore, this qualifies as an AI Incident under the framework, as the AI system's malfunction directly led to harm to a person and violation of rights.[AI generated]
AI principles
FairnessAccountability

Industries
Government, security, and defence

Affected stakeholders
General public

Harm types
Human or fundamental rightsPsychologicalReputational

Severity
AI incident

Business function:
Compliance and justice

AI system task:
Recognition/object detection


Articles about this incident or hazard