Michael Cohen Submits AI-Generated Fake Legal Citations in Court Filing

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Michael Cohen, former lawyer for Donald Trump, submitted a court motion containing fake legal case citations generated by Google Bard, an AI chatbot. Although the incident caused embarrassment and procedural issues, a federal judge declined to impose sanctions, finding no evidence of bad faith or intentional misconduct.[AI generated]

Why's our monitor labelling this an incident or hazard?

The AI system (Google Bard) was used for legal research and generated fake cases that were mistakenly believed to be real and cited in court filings. This misuse of AI-generated content led to false legal claims, which is a violation of legal obligations and could be considered a breach of law and ethical standards. The event involves realized harm in the form of misleading the court and potential perjury, directly linked to the AI system's outputs. Therefore, it meets the criteria for an AI Incident due to the direct role of AI in causing harm related to legal rights and obligations.[AI generated]
AI principles
AccountabilitySafetyTransparency & explainability

Industries
Government, security, and defence

Affected stakeholders
Government

Harm types
ReputationalPublic interest

AI system task:
Content generation

In other databases

Articles about this incident or hazard