AI-Generated Legal Advice Overwhelms Bavarian Social Courts

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

In Bavaria, widespread use of AI tools for legal advice has led to a surge in frivolous lawsuits at social courts. The AI systems, lacking expertise in social law, generate unsound claims, causing significant delays and operational strain on the judicial system due to the increased workload.[AI generated]

Why's our monitor labelling this an incident or hazard?

An AI system is explicitly involved as plaintiffs use AI-generated advice to file lawsuits. The AI's poor understanding of social law leads to many unsound claims, which the courts must process, causing operational disruption and delays. This fits the definition of an AI Incident because the AI system's use indirectly leads to harm in the form of disruption to critical infrastructure (the court system) and harm to communities through delayed justice.[AI generated]
AI principles
AccountabilityRobustness & digital security
Industries
Government, security, and defence
Affected stakeholders
GovernmentWorkers
Harm types
Economic/PropertyPublic interest
Business function:
Compliance and justice
AI system task:
Content generation

Articles about this incident or hazard