Uber Eats Settles After AI Facial Recognition Discriminates Against Driver

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Uber Eats paid a financial settlement to driver Pa Edrissa Manjang after its Microsoft-powered AI facial recognition system repeatedly failed to verify his identity, locking him out of work. The Equality and Human Rights Commission and a union supported his claim, highlighting racial bias and harm caused by the AI system.[AI generated]

Why's our monitor labelling this an incident or hazard?

The facial recognition system is an AI system used in the employment context. Its malfunction or biased performance caused direct harm to the driver by unfairly restricting his access to work opportunities, which is a violation of labor rights and potentially human rights. The payout and legal claim confirm that harm occurred. Therefore, this event qualifies as an AI Incident due to realized discriminatory harm caused by the AI system's use.[AI generated]
AI principles
FairnessRespect of human rightsAccountabilityRobustness & digital securityTransparency & explainability
Industries
Digital securityLogistics, wholesale, and retail
Affected stakeholders
Workers
Harm types
Economic/PropertyPsychologicalHuman or fundamental rights
Business function:
ICT management and information security
AI system task:
Recognition/object detection

Articles about this incident or hazard