At least 25 murder, rape accused whom Delhi Police software caught at Jantar Mantar were in jail, records show
2026-09-04
The Indian Express
The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
Delhi Police's facial recognition system flagged at least 25 individuals as present at the Jantar Mantar protests, despite police, prison, and court records confirming they were in jail at the time. This AI system malfunction raises concerns about wrongful identification, legal fairness, and potential violations of fundamental rights.[AI generated]
Why's our monitor labelling this an incident or hazard?
The event involves an AI system (facial recognition software) used by law enforcement to identify individuals at a protest. The system's errors, such as identifying jailed individuals as present at the protest, demonstrate malfunction or misuse leading to potential harm, including violations of rights and legal protections. The AI system's role is pivotal in causing these harms, as the misidentifications stem directly from its outputs. Although the police state that field verification is required before action, the initial false identifications themselves represent an AI Incident due to the direct or indirect harm caused by the AI system's malfunction or erroneous outputs affecting individuals' rights and legal standing.[AI generated]