The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
The Dutch probation service suspended the OXREC AI algorithm after an official investigation revealed it produced inaccurate and discriminatory recidivism risk assessments for suspects and offenders. Errors in formulas and data led to underestimated risks, affecting legal decisions and potentially violating individual rights since 2018.[AI generated]
Why's our monitor labelling this an incident or hazard?
The algorithm is an AI system used to predict recidivism risk, which directly impacts decisions affecting individuals' rights and freedoms. The presence of serious errors implies that the AI system's use has led or could lead to violations of human rights or legal obligations. The recommendation to stop or adjust the system indicates recognized harm or risk of harm. Therefore, this qualifies as an AI Incident due to the direct or indirect harm caused by the AI system's malfunction or misuse in a sensitive context.[AI generated]