UK Court Upholds Police Use of AI Facial Recognition Despite Misidentification and Rights Concerns

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

The UK High Court upheld the Metropolitan Police's use of live AI facial recognition technology, despite legal challenges citing misidentification, wrongful detention, and potential racial bias. The ruling allows nationwide rollout, raising ongoing concerns about privacy violations and discriminatory impacts on individuals in London.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves an AI system (live facial recognition) whose malfunction (misidentification) directly caused harm to an individual (wrongful detention and questioning), which constitutes injury to personal rights and privacy. The use of LFR also raises concerns about potential discrimination and chilling effects on freedoms, which are human rights issues. The court ruling confirms the system's continued use despite these harms. Since harm has occurred and is directly linked to the AI system's malfunction and use, this event meets the criteria for an AI Incident rather than a hazard or complementary information.[AI generated]
AI principles
FairnessPrivacy & data governance

Industries
Government, security, and defence

Affected stakeholders
General public

Harm types
Human or fundamental rights

Business function:
Compliance and justice

AI system task:
Recognition/object detection


Articles about this incident or hazard