California Attorney Fined $10k for Filing an Appeal With Fake Legal Citations Generated by AI
2025-09-22
U.S. News & World Report
The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
Multiple US attorneys, including in California and New Jersey, were fined and sanctioned for submitting court filings containing fabricated legal citations generated by AI tools like ChatGPT. These incidents highlight the risks of unverified AI outputs in legal proceedings and have prompted courts to issue warnings and impose record fines.[AI generated]
Why's our monitor labelling this an incident or hazard?
The event involves the use of an AI system (ChatGPT) that generated fake legal citations, which the attorney submitted without verification. This misuse of AI directly caused harm by misleading the court, violating legal norms, and wasting judicial resources. The fine and court opinion demonstrate that the AI system's outputs led to a breach of obligations under applicable law and harmed the integrity of the legal process. Therefore, this qualifies as an AI Incident due to realized harm stemming from AI use in a professional legal context.[AI generated]