ShotSpotter AI Evidence Manipulation Leads to Legal Harm in U.S. Cities

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

ShotSpotter, an AI-based gunshot detection system used in over 100 U.S. cities, has been implicated in legal harm after analysts manually altered AI-generated evidence at police request. These modifications, used in criminal cases, have led to wrongful implications and raised concerns about reliability, transparency, and civil rights violations.[AI generated]

Why's our monitor labelling this an incident or hazard?

The AI system (ShotSpotter) is explicitly mentioned and is central to the event. The manual overriding and alteration of AI-generated alerts by analysts, at the request of police departments, directly affected the evidence used in criminal prosecutions. This has led to potential violations of rights and undermines the integrity of the legal process, which is a clear harm under the framework. The harm is realized, not just potential, as evidenced by the withdrawal of evidence and court challenges. Hence, this is an AI Incident rather than a hazard or complementary information.[AI generated]
AI principles
AccountabilityTransparency & explainabilityRespect of human rightsRobustness & digital securitySafetyDemocracy & human autonomy

Industries
Government, security, and defence

Affected stakeholders
General public

Harm types
Human or fundamental rightsReputationalPublic interest

Business function:
Compliance and justice

AI system task:
Recognition/object detectionEvent/anomaly detection

In other databases


Articles about this incident or hazard