Black Teen Wrongfully Banned by Facial Recognition at Michigan Skating Rink

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A Black teenager, Lamya Robinson, was wrongly barred from Riverside Arena in Livonia, Michigan after its facial recognition system misidentified her as someone previously banned. The incident, which her family describes as racial profiling, highlights ongoing concerns about AI bias and the harm caused by inaccurate facial recognition technology.[AI generated]

Why's our monitor labelling this an incident or hazard?

The incident clearly involves an AI system (facial recognition software) whose malfunction (misidentification with a high confidence score) directly caused harm to a person by wrongful exclusion and racial profiling. The harm relates to violations of rights and harm to communities through discriminatory access to public spaces. Therefore, this qualifies as an AI Incident under the framework, as the AI system's malfunction has directly led to harm.[AI generated]
AI principles
FairnessRespect of human rightsTransparency & explainabilityAccountability

Industries
Travel, leisure, and hospitality

Affected stakeholders
ConsumersChildren

Harm types
PsychologicalHuman or fundamental rights

Business function:
Monitoring and quality control

AI system task:
Recognition/object detection

In other databases

Articles about this incident or hazard