The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
In Brazil, lawyers inserted hidden commands (prompt injection) into legal documents to manipulate AI systems used by courts, notably the Tribunal de Justiça de Minas Gerais (TJMG). This led to judicial sanctions, ethical and criminal investigations, and raised concerns about the integrity of AI-assisted judicial processes.[AI generated]
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI systems used in judicial decision support being manipulated through prompt injection, a form of malicious input designed to alter AI outputs. This manipulation has already occurred in multiple cases, leading to fines and investigations, which shows realized harm. The harm includes undermining the fairness and integrity of judicial decisions, which can be considered a violation of legal rights and harm to communities relying on justice. The AI system's use was exploited maliciously, fulfilling the criteria for an AI Incident. The article also discusses ongoing responses and mitigation efforts, but the primary focus is on the incidents themselves, not just complementary information.[AI generated]