South Korean Courts Respond to AI-Generated Fake Legal Documents

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

South Korean courts have faced increasing incidents of AI-generated fake legal precedents and evidence being submitted in legal proceedings, causing delays and unnecessary costs. In response, the judiciary has proposed measures including cost penalties, disciplinary action for lawyers, mandatory AI-use disclosure, and system upgrades to verify legal documents' authenticity.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves AI systems generating fake legal precedents and laws that have been actually submitted to courts, causing delays and unnecessary costs, which constitute harm to the legal system and potentially violate legal rights. The involvement of AI in producing false information that disrupts court operations and leads to financial and procedural harm fits the definition of an AI Incident. The article focuses on the harm caused and the responses to it, not just potential future harm or general AI news, so it is classified as an AI Incident.[AI generated]
AI principles
AccountabilityTransparency & explainability

Industries
Government, security, and defence

Affected stakeholders
GovernmentGeneral public

Harm types
Economic/PropertyPublic interest

Business function:
Compliance and justice

AI system task:
Content generation


Articles about this incident or hazard