Widespread Use of AI-Generated Fake Legal Precedents in South Korean Courts

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A survey of 360 South Korean judges revealed that about 80% have encountered AI-generated fake or non-existent legal precedents cited in court documents, often by both litigants and lawyers. This misuse of AI has led to misinformation, delays, and potential violations of legal rights, prompting calls for regulatory reforms.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves the use of AI systems to generate legal documents containing fabricated case law, which has directly caused harm to the judicial process and legal rights by misleading courts and wasting judicial resources. This fits the definition of an AI Incident because the AI system's use has directly led to harm (violation of legal procedural integrity and potential harm to rights). The article also mentions responses but the primary focus is on the realized harm caused by AI-generated false information in legal proceedings, not just potential or complementary information.[AI generated]
AI principles
Robustness & digital securityTransparency & explainability

Industries
Government, security, and defence

Affected stakeholders
GovernmentGeneral public

Harm types
Human or fundamental rightsPublic interest

Business function:
Compliance and justice

AI system task:
Content generation


Articles about this incident or hazard