The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
The Metropolitan Police in London used AI-powered live facial recognition over six months in Croydon, identifying over 2,000 suspects and making 173 arrests, with only one reported misidentification out of 470,000 scans. Civil rights groups raised concerns about privacy violations and false positives, prompting calls for regulatory oversight.[AI generated]
Why's our monitor labelling this an incident or hazard?
The article explicitly describes an AI system (live facial recognition based on AI algorithms) being used operationally by law enforcement and private entities, leading to direct outcomes such as arrests and crime reduction. These outcomes constitute realized harms and benefits, but the privacy and civil rights concerns raised indicate violations of rights and potential harms to communities. The AI system's role is pivotal in these outcomes. Therefore, the event meets the criteria for an AI Incident due to direct involvement of AI in causing harm (privacy, rights violations) and law enforcement actions (arrests).[AI generated]