AI-Generated Fake Legal Citations Lead to Invalid Parole Condition in Tasmania

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Tasmania's Parole Board imposed a parole condition on Susan Neill-Fraser, restricting her media communication, based on AI-generated documents citing non-existent case law. The Supreme Court ruled the condition invalid due to procedural unfairness, prompting a review of AI use in parole decisions by the Justice Department.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly states that the Parole Board relied on a document prepared with the help of AI, which contained a fabricated legal citation. This reliance led to the imposition of an invalid parole condition restricting the parolee's freedom to speak, a clear violation of her rights. The harm is realized and significant, involving legal and human rights breaches. The AI system's use in generating misleading or incorrect legal information directly contributed to this harm, meeting the criteria for an AI Incident under violations of human rights and breach of legal obligations.[AI generated]
AI principles
Respect of human rightsTransparency & explainability

Industries
Government, security, and defence

Affected stakeholders
General public

Harm types
Human or fundamental rights

Business function:
Compliance and justice

AI system task:
Content generation


Articles about this incident or hazard