Denver Woman Wrongly Accused of Theft Due to AI-Driven Flock Camera Error

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A Denver woman, Chrisanna Elser, was wrongfully accused of package theft after police relied on Flock Safety AI cameras to track her vehicle. The AI system's data led to a court summons, later voided, but caused reputational and emotional harm, highlighting risks of AI misuse in law enforcement.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event explicitly involves AI-enabled surveillance cameras (Flock cameras) used by police to identify suspects. The AI system's outputs were relied upon to accuse a person wrongly, causing harm to her reputation and legal standing. The harm is indirect but clear: wrongful accusation and the burden of proving innocence shifted to the accused. This fits the definition of an AI Incident as the AI system's use directly led to harm (violation of rights and harm to the individual).[AI generated]
AI principles
AccountabilityFairnessTransparency & explainabilityRobustness & digital securityRespect of human rightsSafety

Industries
Government, security, and defence

Affected stakeholders
General public

Harm types
ReputationalPsychological

Severity
AI incident

Business function:
Compliance and justice

AI system task:
Recognition/object detection


Articles about this incident or hazard