The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
The Metropolitan Police's use of live facial recognition (LFR) at the Notting Hill Carnival has sparked criticism from civil rights groups and London Assembly members, citing concerns over bias, misidentification, and human rights violations, particularly affecting women and minority communities. Despite police assurances of improved accuracy, critics argue the technology remains discriminatory and undermines public trust.[AI generated]
Why's our monitor labelling this an incident or hazard?
The event involves an AI system (live facial recognition) used by law enforcement to identify individuals from live video feeds. The system's use has directly led to arrests, indicating realized impact. There are documented cases of false matches causing harm through wrongful suspicion or identification, which constitutes harm to individuals' rights and potentially to communities. The concerns about bias and privacy violations further indicate violations of human rights and legal obligations. Therefore, this qualifies as an AI Incident because the AI system's use has directly led to harms including wrongful identification and potential rights violations.[AI generated]