Labour Court Overturns Ruling After Commissioner Relies on AI-Generated Fake Judgment

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

The Johannesburg Labour Court set aside a CCMA commissioner's ruling after he relied on a non-existent, AI-generated legal judgment. The court found this reliance led to an unlawful decision regarding unfair dismissal claims by former South African Post Office employees, highlighting the dangers of unverified AI outputs in legal proceedings.[AI generated]

Why's our monitor labelling this an incident or hazard?

The AI system (likely a large language model or similar AI used for legal research) produced a fabricated judgment citation that the commissioner relied upon without verification. This reliance directly caused an unlawful ruling, violating legal rights and procedural fairness, which constitutes harm under the category of violations of human rights or breach of legal obligations. The harm is realized and materialized, not merely potential. Hence, this is an AI Incident due to the AI's malfunction (hallucination) leading to a harmful legal outcome.[AI generated]
AI principles
Transparency & explainabilityAccountability

Industries
Government, security, and defence

Affected stakeholders
Workers

Harm types
Economic/PropertyPublic interest

Business function:
Compliance and justice

AI system task:
Content generation


Articles about this incident or hazard