AI Crime Prediction Algorithm Raises Concerns Over Policing Bias and Future Risks

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

University of Chicago researchers developed an AI algorithm that predicts violent and property crimes up to a week in advance with 90% accuracy. While the system revealed existing police enforcement bias favoring wealthier neighborhoods, no direct harm from the AI's use has occurred, though future misuse could pose risks.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves an AI system explicitly described as predicting crime based on historical data. The article discusses the system's development and intended use, as well as concerns about systemic bias and its complex relationship with policing and society. However, there is no report of actual harm or incidents caused by the AI system's use; rather, the concerns are about plausible future harms related to bias and enforcement disparities. Therefore, this qualifies as an AI Hazard because the AI system's use could plausibly lead to harms such as biased policing or discrimination, but no direct or indirect harm has yet materialized according to the article.[AI generated]
AI principles
FairnessTransparency & explainabilityAccountabilityPrivacy & data governanceRespect of human rightsRobustness & digital securityDemocracy & human autonomySafety

Industries
Government, security, and defenceEducation and training

Affected stakeholders
General public

Harm types
Human or fundamental rightsPublic interestReputationalPsychological

Business function:
Compliance and justiceResearch and development

AI system task:
Forecasting/prediction


Articles about this incident or hazard