Anthropic Faces Legal Scrutiny Over AI-Generated Fictitious Citation

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Anthropic is under legal scrutiny after a data scientist allegedly submitted a court filing with an AI-generated, non-existent academic citation. Music publishers claim the fabricated reference was used to defend the company in a copyright lawsuit, raising concerns about AI misuse in legal proceedings and intellectual property integrity.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event describes a direct consequence of an AI system's output (Claude generating a fabricated citation) that has been used in a legal context, potentially misleading the court and impacting the copyright dispute. This constitutes a violation of intellectual property rights and legal obligations, fitting the definition of an AI Incident. The AI system's malfunction (hallucination) directly led to harm in the form of legal misrepresentation and possible infringement issues. Therefore, this is classified as an AI Incident rather than a hazard or complementary information.[AI generated]
AI principles
AccountabilityRobustness & digital securityTransparency & explainabilitySafetyDemocracy & human autonomy

Industries
Arts, entertainment, and recreationGovernment, security, and defenceReal estate

Affected stakeholders
BusinessGeneral public

Harm types
ReputationalPublic interest

Business function:
Compliance and justice

AI system task:
Content generation

In other databases

Articles about this incident or hazard