Innocent Man Wrongly Targeted by AI-Driven Geofence Warrant

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Florida police used Google's AI-powered geofence warrant system to collect location data, wrongly identifying Zachary McCoy as a burglary suspect because his bike route passed the crime scene. The AI system's data sharing led to legal and emotional harm for the innocent man, highlighting risks of AI-driven surveillance.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event describes how Google's AI-powered location tracking system was used by police to identify suspects based on location data. The system's data led to Zachary McCoy being wrongly suspected of a robbery, despite having no involvement. This is a direct example of AI system use leading to harm (wrongful suspicion), which is a violation of rights and can cause significant personal harm. The AI system's role is pivotal as it provided the data that triggered the suspicion. Hence, this is an AI Incident rather than a hazard or complementary information.[AI generated]
AI principles
Privacy & data governanceAccountabilityTransparency & explainabilityRespect of human rightsRobustness & digital security

Industries
Government, security, and defence

Affected stakeholders
General public

Harm types
PsychologicalReputationalHuman or fundamental rights

Business function:
Compliance and justice

AI system task:
Event/anomaly detection


Articles about this incident or hazard