São Paulo Court Suspends Metro Facial Recognition System Over Rights Concerns

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A São Paulo court, led by Judge Maria Laura Tavares, upheld the suspension of a facial recognition AI system in the city's metro, citing risks of violating users' fundamental rights and privacy. The decision follows legal challenges from public defenders and civil groups, pending further review and transparency on data use.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves an AI system (facial recognition) whose deployment is legally blocked due to concerns about potential violations of fundamental rights and data privacy. Since the system is not yet operational and no harm has occurred, but there is a credible risk of harm if it were to be installed, this qualifies as an AI Hazard. The judicial decision aims to prevent plausible future harm rather than reporting an incident where harm has already occurred.[AI generated]
AI principles
Privacy & data governanceRespect of human rightsTransparency & explainabilityAccountabilityRobustness & digital securityDemocracy & human autonomy

Industries
Government, security, and defenceMobility and autonomous vehiclesDigital security

Affected stakeholders
General public

Harm types
Human or fundamental rightsPsychological

Business function:
Monitoring and quality control

AI system task:
Recognition/object detection

In other databases

Articles about this incident or hazard