Concerns Over Police AI Facial Recognition System

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Brandenburg data protection officials, including Dagmar Hartge, have raised concerns regarding a police AI facial recognition system that scans and compares the faces of thousands of public individuals against a police database. The system is seen as disproportionate and poses risks to privacy and fundamental rights.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves an AI system explicitly described as a facial recognition program used by police for suspect identification. The system's use has directly led to privacy harms and potential violations of fundamental rights, as it processes images of thousands of uninvolved individuals without proportional justification. The data protection authority's criticism and imposed fines indicate recognized harm. Therefore, this qualifies as an AI Incident because the AI system's use has directly led to violations of rights and privacy harms. The article also discusses broader data protection issues related to AI, reinforcing the assessment of realized harm rather than mere potential risk.[AI generated]
AI principles
Privacy & data governanceRespect of human rightsTransparency & explainabilityAccountabilityDemocracy & human autonomyFairness
Industries
Government, security, and defence
Affected stakeholders
General public
Harm types
Human or fundamental rightsPublic interestPsychological
Severity
AI incident
Business function:
Compliance and justice
AI system task:
Recognition/object detection

Articles about this incident or hazard