UK Facial Recognition AI in Policing and Schools Raises Racial Bias and Privacy Concerns

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Facial recognition AI used by the UK Metropolitan Police and in over 60 schools has shown racial bias, particularly against Black individuals at certain thresholds, and has led to privacy violations and coercive practices. Rights groups warn these deployments contribute to discrimination and an expanding surveillance society.[AI generated]

Why's our monitor labelling this an incident or hazard?

Live facial recognition is an AI system that processes biometric data to identify individuals in real time. The article details its use by the Met Police and the resulting harms, including unlawful use, privacy infringements, and discriminatory misidentifications. These harms fall under violations of human rights and data protection laws, fulfilling the criteria for an AI Incident. The article does not merely discuss potential risks or policy responses but documents actual use and associated harms, making it an AI Incident rather than a hazard or complementary information.[AI generated]
AI principles
FairnessPrivacy & data governanceRespect of human rightsTransparency & explainabilityAccountabilityRobustness & digital securityHuman wellbeingDemocracy & human autonomy

Industries
Government, security, and defenceEducation and training

Affected stakeholders
General publicChildren

Harm types
Human or fundamental rightsPsychologicalPublic interest

Business function:
Compliance and justiceMonitoring and quality control

AI system task:
Recognition/object detection


Articles about this incident or hazard