São Paulo Metro Faces Legal Action Over Facial Recognition System

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Public defenders and civil organizations have filed a lawsuit demanding São Paulo Metro halt its facial recognition system, alleging violations of privacy, data protection, and children's rights. The plaintiffs seek an immediate ban and R$42 million in damages, citing risks of indiscriminate biometric data collection without user consent.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves an AI system (facial recognition technology) whose use is contested due to alleged violations of legal frameworks and risks of discrimination and privacy invasion. Although no direct harm is reported as having occurred, the legal action aims to prevent ongoing or future harm to millions of passengers. This fits the definition of an AI Hazard, as the development and use of the AI system could plausibly lead to harms such as violations of rights and discrimination. The event does not describe an actual incident of harm but focuses on the potential risks and legal challenges, so it is not an AI Incident. It is not merely complementary information because the main focus is the legal action against the AI system's use, not a response or update to a prior incident.[AI generated]
AI principles
Privacy & data governanceRespect of human rightsTransparency & explainabilityAccountabilityDemocracy & human autonomyRobustness & digital securityFairness

Industries
Government, security, and defenceMobility and autonomous vehicles

Affected stakeholders
General publicChildren

Harm types
Human or fundamental rightsPublic interestEconomic/PropertyReputational

Business function:
Monitoring and quality control

AI system task:
Recognition/object detection


Articles about this incident or hazard