Driver Follows AI Legal Advice, Faces Higher Fine in Zabrze

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A 30-year-old driver in Zabrze, Poland, consulted an AI assistant for legal advice after being stopped for speeding. The AI advised him to refuse the 100 zł fine, leading to a court case and a penalty eight times higher. The incident highlights the risks of relying on AI for legal guidance.[AI generated]

Why's our monitor labelling this an incident or hazard?

An AI system was explicitly involved as the driver relied on its advice to refuse the fine. This advice directly influenced the driver's behavior, which resulted in a legal penalty that was more severe than the original fine. The harm here is financial and legal, stemming indirectly from the AI's advice. Therefore, this qualifies as an AI Incident because the AI system's use directly led to harm (financial/legal penalty) to the individual.[AI generated]
AI principles
SafetyTransparency & explainability

Industries
Government, security, and defence

Affected stakeholders
Consumers

Harm types
Economic/Property

AI system task:
Interaction support/chatbotsReasoning with knowledge structures/planning


Articles about this incident or hazard