AI Traffic Camera in Bengaluru Fines Man After Mistaking Guitar for Helmetless Pillion Rider

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

In Bengaluru, an AI-powered traffic camera misidentified a guitar bag strapped to Souvik Dutta's back as a helmetless pillion rider, resulting in a wrongful Rs 500 fine. The incident highlights the risks of AI misclassification in automated law enforcement and led to public appeals for the penalty's cancellation.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves an AI system used for traffic violation detection that malfunctioned by misidentifying an object (guitar) as a passenger, causing an erroneous fine. This malfunction directly led to a harm in the form of an unjust penalty and violation of the individual's rights. Therefore, this qualifies as an AI Incident due to the AI system's malfunction causing direct harm.[AI generated]
AI principles
AccountabilityRobustness & digital security
Industries
Government, security, and defence
Affected stakeholders
General public
Harm types
Economic/Property
Business function:
Compliance and justice
AI system task:
Recognition/object detection

Articles about this incident or hazard