
The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
A Romanian lawyer was banned for two years from representing clients before the European Court of Human Rights after submitting legal documents containing fabricated and erroneous citations generated by AI tools, including ChatGPT. The unverified AI-generated content undermined legal proceedings and led to professional sanctions.[AI generated]
Why's our monitor labelling this an incident or hazard?
The AI system was explicitly used in the preparation of legal pleadings, and its outputs included fabricated and incorrect legal citations, which were submitted to a high court. This directly led to harm by impairing the justice process and causing procedural difficulties for the court, fulfilling the criteria for an AI Incident under the definition of harm to the management and operation of critical infrastructure (here, the justice system) and violations of professional and legal obligations. The harm is realized and significant, not merely potential, and the AI's role is pivotal as the source of the fabricated information. Therefore, this event qualifies as an AI Incident.[AI generated]