Facial Recognition Trial by WA Police Leads to Arrests and Raises Ethical Concerns

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

The Western Australian Police Force trialed live facial recognition technology, scanning over 900,000 faces and making 79 arrests, including engaging with registered sex offenders. The system generated eight incorrect alerts, raising concerns about privacy, wrongful identification, and ethical implications of AI use in policing.[AI generated]

Why's our monitor labelling this an incident or hazard?

The facial recognition system is an AI system used in policing, which directly led to arrests and incorrect alerts affecting individuals' rights and privacy. The article discusses realized harms including privacy violations and potential discriminatory impacts on marginalized groups, which constitute violations of human rights and harm to communities. The ethical concerns about accountability and fairness further support the classification as an AI Incident rather than a hazard or complementary information. The presence of actual incorrect alerts and the impact on individuals confirm that harm has occurred, not just potential harm.[AI generated]
AI principles
Privacy & data governanceFairness

Industries
Government, security, and defence

Affected stakeholders
General public

Harm types
Human or fundamental rightsReputationalPsychological

Business function:
Compliance and justice

AI system task:
Recognition/object detection


Articles about this incident or hazard