AI-Generated Fake Case Law Submitted in California Insurance Lawsuit

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Attorneys representing State Farm in a Los Angeles insurance lawsuit submitted court filings containing fabricated case citations generated by an AI legal research tool. The false information, discovered by opposing counsel, led to apologies and raised concerns about AI's reliability in legal proceedings, directly undermining judicial integrity and plaintiffs' rights.[AI generated]

Why's our monitor labelling this an incident or hazard?

The AI system was used in the development of legal filings and malfunctioned by hallucinating false case law. This directly led to harm in the form of misleading the court and undermining the integrity of legal proceedings, which is a violation of legal and professional obligations. The harm is realized and materialized, not just potential. Therefore, this event qualifies as an AI Incident rather than a hazard or complementary information.[AI generated]
AI principles
AccountabilityTransparency & explainability

Industries
Other

Affected stakeholders
Other

Harm types
Public interestReputationalHuman or fundamental rights

Business function:
Compliance and justice

AI system task:
Content generation

In other databases

Articles about this incident or hazard