Western Australia Police's Live Facial Recognition Trial Raises Privacy and Discrimination Concerns

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Western Australia Police trialed live facial recognition technology in Perth and Fremantle, scanning over 130,000 faces and making at least 18 arrests. The AI system generated false positives and raised concerns about privacy, lack of consultation, and potential discrimination against Aboriginal communities due to algorithmic bias and opaque watchlists.[AI generated]

Why's our monitor labelling this an incident or hazard?

The live facial recognition system is an AI system actively used by police to identify and arrest individuals, directly leading to harm in the form of potential wrongful stops and privacy violations. The article reports actual arrests and alerts generated by the system, indicating realized harm rather than just potential risk. The concerns about bias and lack of independent oversight further underscore the risk of rights violations. Since harm has occurred and is ongoing, this event meets the criteria for an AI Incident rather than an AI Hazard or Complementary Information.[AI generated]
AI principles
Privacy & data governanceFairness

Industries
Government, security, and defence

Affected stakeholders
General public

Harm types
Human or fundamental rightsPsychological

AI system task:
Recognition/object detection


Articles about this incident or hazard