Essex Police tweaks 'biased' facial recognition software
2026-03-20
BBC
The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
Essex Police paused its use of live facial recognition cameras after studies found the AI system disproportionately identified Black individuals compared to other ethnic groups, raising concerns about racial bias and fairness. The suspension aims to address these issues by updating the algorithm and reviewing deployment practices.[AI generated]
Why's our monitor labelling this an incident or hazard?
The facial recognition system is an AI system used in live deployments by Essex Police. The study found statistically significant bias in identification rates against certain ethnic groups, which constitutes a violation of rights and discriminatory harm. The system's biased outputs have led to real-world interventions and arrests, including at least one mistaken intervention, demonstrating direct harm. The police's decision to pause and update the system confirms the recognition of harm caused by the AI system's malfunction. Hence, this event meets the criteria for an AI Incident due to realized harm linked to the AI system's biased operation.[AI generated]