Colombian Lawyer Fined for Submitting AI-Generated False Legal Citations

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

The Colombian Supreme Court fined lawyer Jorge Hernán Zapata Vargas approximately $6,000 for submitting a legal appeal containing fabricated laws and precedents generated by an AI tool. The court found the AI-generated content undermined judicial integrity and violated professional duties, highlighting risks of unverified AI use in legal processes.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event explicitly involves the use of an AI system (a generative language model) to produce false legal content that was submitted in a judicial process. This misuse directly caused harm by introducing false information into the legal system, violating professional and legal obligations, and misleading the court. The harm is a violation of legal and professional rights and duties, fitting the definition of an AI Incident. The court's sanction and the disciplinary proceedings further confirm the realized harm and the AI system's pivotal role in causing it.[AI generated]
AI principles
AccountabilityTransparency & explainability

Industries
Government, security, and defence

Affected stakeholders
GovernmentGeneral public

Harm types
ReputationalPublic interest

Severity
AI incident

Business function:
Compliance and justice

AI system task:
Content generation


Articles about this incident or hazard