US judge warns Justice Department about AI use in immigration case
2026-07-16
Reuters
The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
A federal judge in Michigan reprimanded the US Department of Justice after a government attorney submitted a court filing containing a fake legal citation, likely generated by AI. The judge warned about the risks of generative AI in legal proceedings and emphasized the need for attorneys to verify AI-generated content.[AI generated]
Why's our monitor labelling this an incident or hazard?
The event involves the use of generative AI in producing legal citations that were fabricated or hallucinated, which directly led to harm in the form of misleading the court and potentially affecting the plaintiff's case. The judge explicitly raised concerns about AI use and the need for attorneys to verify AI-generated content to maintain candor and legal integrity. This constitutes a violation of legal obligations and harms the judicial process, meeting the criteria for an AI Incident. The harm is realized, not just potential, as the court had to address the issue and caution the government.[AI generated]