Italy Deploys Giove AI for Predictive Policing, Raising Rights Concerns

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

The Italian police are introducing Giove, an AI system designed to predict and prevent high-impact crimes by analyzing past data. While no harm has yet occurred, experts warn of potential risks such as privacy violations and discrimination, as predictive policing algorithms may reinforce biases and infringe on civil rights.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article describes the development and intended use of an AI system (Giove) for predictive policing, which could plausibly lead to harms such as discrimination, privacy violations, and biased law enforcement practices. However, no actual harm or incident has been reported as occurring so far. The concerns and parliamentary inquiry suggest potential risks, making this an AI Hazard rather than an AI Incident or Complementary Information. The system's deployment and effects remain to be seen, so it is not unrelated.[AI generated]
AI principles
FairnessPrivacy & data governanceRespect of human rightsTransparency & explainabilityAccountabilityDemocracy & human autonomy

Industries
Government, security, and defence

Affected stakeholders
General public

Harm types
Human or fundamental rightsPublic interestPsychological

Severity
AI hazard

Business function:
Compliance and justice

AI system task:
Forecasting/predictionEvent/anomaly detection


Articles about this incident or hazard

Thumbnail Image

Intelligenza artificiale, la Polizia arruola l'investigatore Giove - Il Sole 24 ORE

2023-06-06
Il Sole 24 ORE
Why's our monitor labelling this an incident or hazard?
Giove is explicitly described as an AI system used by law enforcement to predict and prevent crimes, which involves the use of AI for decision support in policing. However, the article does not report any realized harm or incidents resulting from the system's use, nor does it mention any malfunction or misuse leading to harm. The system's deployment and use could plausibly lead to harms such as violations of rights or discriminatory outcomes, but these are not stated or evidenced in the article. Therefore, this event is best classified as Complementary Information, providing context on AI adoption in policing without reporting an AI Incident or Hazard.
Thumbnail Image

Cosa sappiamo di Giove, l'algoritmo con cui la polizia italiana vuole prevedere i reati

2023-06-07
Fanpage
Why's our monitor labelling this an incident or hazard?
The article describes the development and intended use of an AI system (Giove) for predictive policing, which could plausibly lead to harms such as discrimination, privacy violations, and biased law enforcement practices. However, no actual harm or incident has been reported as occurring so far. The concerns and parliamentary inquiry suggest potential risks, making this an AI Hazard rather than an AI Incident or Complementary Information. The system's deployment and effects remain to be seen, so it is not unrelated.
Thumbnail Image

"Predire e prevenire i reati". Così la polizia si affida a Giove e all'AI per la lotta al crimine

2023-06-05
il Giornale.it
Why's our monitor labelling this an incident or hazard?
Giove is an AI system explicitly described as performing predictive analysis to forecast crime locations and timings, which fits the definition of an AI system. Its use by law enforcement to predict and prevent crimes directly relates to the use of AI leading to potential impacts on individuals and communities. While the article does not report any realized harm yet, the deployment of predictive policing AI systems is widely recognized as raising significant concerns about privacy violations, potential discrimination, and human rights infringements. The article also highlights privacy concerns and regulatory challenges, indicating plausible risks of violations of human rights and privacy. Therefore, the event plausibly leads to harms such as violations of rights and harm to communities through potential misuse or biased predictions. Since no actual harm is reported yet but plausible future harm is credible, this event qualifies as an AI Hazard rather than an AI Incident.
Thumbnail Image

Giove, con la polizia predittiva l'Italia guarda a un futuro alla Minority Report?

2023-06-06
Hardware Upgrade - Il sito italiano sulla tecnologia
Why's our monitor labelling this an incident or hazard?
Giove is explicitly described as an AI system used for predictive policing, involving automated analysis of sensitive data to forecast crime patterns. Although no direct harm or incident has been reported, the article highlights credible risks related to privacy violations, potential bias, and misuse of data, which could lead to violations of human rights or harm to communities. The system's development and intended use create a plausible risk of future harm, fitting the definition of an AI Hazard. Since no realized harm is described, it cannot be classified as an AI Incident. The article is not merely complementary information because it focuses on the system's capabilities and associated risks rather than updates or responses to past incidents.
Thumbnail Image

Lotta alla criminalità con l'Intelligenza artificiale

2023-06-06
Adnkronos
Why's our monitor labelling this an incident or hazard?
The system Giove is explicitly described as an AI-based automated processing and analysis tool used by law enforcement to predict criminal activity. While the article does not report any realized harm or incidents resulting from its use, the nature of the system—predictive policing—raises plausible risks of harm such as violations of human rights (e.g., privacy, potential bias, discrimination) or other significant harms if misused or malfunctioning. Therefore, this qualifies as an AI Hazard because the AI system's use could plausibly lead to harms, even though no harm is reported yet.
Thumbnail Image

Cosa sappiamo di Giove, il software italiano di polizia predittiva

2023-06-06
Wired
Why's our monitor labelling this an incident or hazard?
Giove is an AI system designed for predictive policing, which could plausibly lead to harms such as violations of privacy, discrimination, and infringement of personal freedoms if deployed without adequate safeguards. The article discusses these potential harms and the ongoing regulatory evaluation but does not report any actual incidents or harms caused by the system so far. Hence, this situation fits the definition of an AI Hazard, as the development and potential use of Giove could plausibly lead to an AI Incident in the future, but no direct or indirect harm has yet occurred.
Thumbnail Image

È stata presentata una interrogazione parlamentare su Giove, il sistema predittivo della polizia

2023-06-07
Wired
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions an AI system (Giove) used for predictive policing, which involves AI-based crime prediction. Although no direct harm has been reported, the concerns raised about privacy violations, biases, and wrongful identification indicate plausible future harms related to human rights violations and privacy breaches. Therefore, this event fits the definition of an AI Hazard, as the development and potential use of this AI system could plausibly lead to an AI Incident involving violations of rights and privacy.
Thumbnail Image

Giove, l'algoritmo usato dalla polizia per prevenire reati | IlSoftware.it

2023-06-08
IlSoftware.it
Why's our monitor labelling this an incident or hazard?
Giove is an AI system explicitly described as being used for crime prevention by analyzing and cross-referencing various data sources to suggest police actions. While the article does not report any realized harm or incidents caused by the system, it discusses its intended use and potential impact on preventing crimes. There is no indication that harm has occurred yet, but the system's deployment could plausibly lead to harms such as privacy violations, discrimination, or misuse, given the nature of predictive policing AI. Therefore, this event fits the definition of an AI Hazard, as it plausibly could lead to AI incidents related to rights violations or other harms in the future.
Thumbnail Image

Nome in codice Giove, ecco l'algoritmo della polizia per prevenire i reati

2023-06-05
Il Sole 24 ORE
Why's our monitor labelling this an incident or hazard?
The event involves an AI system explicitly described as an automated predictive policing tool using AI algorithms. While no actual harm or incident is reported, the system's use in law enforcement to predict and prevent crimes carries credible risks of human rights violations and social harm, making it an AI Hazard. There is no indication of realized harm or malfunction leading to an AI Incident, nor is the article focused on responses or updates to prior incidents, so it is not Complementary Information. Therefore, the classification as AI Hazard is appropriate.