How AI can lead to false arrests and wrongful convictions
2026-05-11
The Conversation
The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
AI-enhanced surveillance cameras and facial recognition software in U.S. law enforcement led to false arrests and wrongful detentions, including a Baltimore student misidentified as carrying a gun and a Tennessee grandmother wrongly jailed for months. Overreliance on AI outputs caused significant harm and rights violations.[AI generated]
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI systems (AI-enhanced surveillance cameras and facial recognition software) whose malfunction or erroneous outputs directly caused harm to individuals (false arrests, wrongful detention). These harms fall under injury or harm to persons and violations of rights. The AI systems' probabilistic nature and human overreliance on their outputs led to these harms. Therefore, this event meets the criteria for an AI Incident because the AI's use and malfunction directly led to realized harm.[AI generated]