AI-Driven Deactivation Policies at Uber and Lyft Disproportionately Harm Drivers of Color

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Uber and Lyft use AI-driven systems to process customer complaints and manage driver deactivations, often without human review. These automated decisions have led to sudden job loss, economic hardship, and disproportionately impact drivers of color and non-native English speakers, raising concerns about discrimination and lack of due process.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves AI systems (algorithmic decision-making tools used by Uber and Lyft) that directly lead to harm (economic hardship, loss of housing, and potential discrimination) to drivers. The deactivation policy is implemented through the app's automated systems, which classify as AI systems due to their decision-making role affecting human livelihoods. The harms are realized and significant, including violations of labor rights and economic harm. Therefore, this qualifies as an AI Incident because the AI system's use has directly led to harm to people and breaches of labor rights.[AI generated]
AI principles
FairnessAccountabilityTransparency & explainabilityRespect of human rightsDemocracy & human autonomyHuman wellbeing

Industries
Mobility and autonomous vehiclesConsumer services

Affected stakeholders
Workers

Harm types
Economic/PropertyPsychologicalHuman or fundamental rightsReputational

Severity
AI incident

Business function:
Human resource managementMonitoring and quality controlCitizen/customer service

AI system task:
Event/anomaly detectionGoal-driven organisation


Articles about this incident or hazard

Thumbnail Image

Column: Uber and Lyft's 'deactivation' policy is dehumanizing and unfair. It must end

2023-02-28
MSN International Edition
Why's our monitor labelling this an incident or hazard?
The event involves AI systems (algorithmic decision-making tools used by Uber and Lyft) that directly lead to harm (economic hardship, loss of housing, and potential discrimination) to drivers. The deactivation policy is implemented through the app's automated systems, which classify as AI systems due to their decision-making role affecting human livelihoods. The harms are realized and significant, including violations of labor rights and economic harm. Therefore, this qualifies as an AI Incident because the AI system's use has directly led to harm to people and breaches of labor rights.
Thumbnail Image

Rideshare Drivers of Color Are More Likely to Be Fired Than White Drivers

2023-03-01
MSN International Edition
Why's our monitor labelling this an incident or hazard?
The rideshare platforms use AI systems to process rider complaints and make decisions about driver deactivation. The study shows that these AI systems or their use result in disproportionate harm to drivers of color, which is a violation of labor rights and discrimination, thus a breach of obligations intended to protect fundamental rights. The harm is realized and ongoing, as drivers report deactivations and lack of support. Therefore, this qualifies as an AI Incident due to the direct or indirect role of AI systems in causing harm through biased or unfair decision-making processes.
Thumbnail Image

Uber and Lyft drivers in California say they've been spontaneously fired by apps, report finds

2023-03-04
Yahoo Sports
Why's our monitor labelling this an incident or hazard?
The apps' automated or semi-automated deactivation processes constitute AI systems making decisions that directly impact drivers' employment status. The reported harms include discrimination, lack of due process, and significant economic and social consequences for drivers, fulfilling criteria for violations of labor rights and harm to communities. The systemic nature and direct impact of these AI-driven decisions classify this as an AI Incident rather than a hazard or complementary information.
Thumbnail Image

Uber and Lyft drivers in California say they've been spontaneously fired by apps, report finds

2023-03-04
NBC News
Why's our monitor labelling this an incident or hazard?
The apps used by Uber and Lyft involve AI systems that process customer complaints and other data to make decisions about driver deactivation. The report indicates that many drivers are deactivated without human review or explanation, which constitutes a use of AI in decision-making affecting employment status. The harms include violations of labor rights, discrimination against drivers of color, and significant personal and economic hardship, fulfilling the criteria for an AI Incident. The AI system's use in automated firing and its discriminatory impact directly led to these harms, making this an AI Incident rather than a hazard or complementary information.
Thumbnail Image

Column: Uber and Lyft's 'deactivation' policy is dehumanizing and unfair. It must end

2023-02-28
Los Angeles Times
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems (algorithms) in the deactivation process of Uber and Lyft drivers, which directly leads to harm (economic hardship, loss of housing, discrimination) to individuals. The AI system's role in decision-making without adequate human review or transparency constitutes a violation of labor rights and causes significant harm to workers. Therefore, this qualifies as an AI Incident due to the realized harm caused by the AI system's use in employment decisions and its impact on human rights and economic well-being.
Thumbnail Image

Uber and Lyft Are More Likely to Fire Drivers of Color

2023-02-28
Wired
Why's our monitor labelling this an incident or hazard?
The platforms use AI or algorithmic systems to process customer complaints and ratings to decide on driver deactivation. This system's use has led to discriminatory outcomes disproportionately affecting drivers of color and non-English speakers, causing harm to their employment and income. This constitutes a violation of labor rights and harm to individuals, fitting the definition of an AI Incident due to the AI system's indirect role in causing harm through biased or unchecked complaint processing and account deactivation.
Thumbnail Image

Rideshare Drivers of Color Are More Likely to Be Fired Than White Drivers

2023-03-01
Jalopnik
Why's our monitor labelling this an incident or hazard?
Rideshare platforms like Uber and Lyft use AI systems for managing driver reputations, complaint evaluations, and account deactivations. The reported disproportionate firing of drivers of color after complaints suggests that the AI systems or their use contribute indirectly to violations of labor rights and discrimination, which are harms under the AI Incident definition. The event describes realized harm (discriminatory dismissals) linked to AI system use in driver management, thus qualifying as an AI Incident.
Thumbnail Image

Brian Merchant: Uber and Lyft's 'deactivation' policy is dehumanizing and unfair. It must end

2023-03-01
ArcaMax
Why's our monitor labelling this an incident or hazard?
The event involves an AI system or algorithmic decision-making embedded in the Uber and Lyft apps that directly leads to harm: permanent deactivation of drivers without due process, causing economic hardship and disproportionate impact on drivers of color. The automated nature of the deactivation (via app notification without human contact) implies AI or algorithmic involvement. The harms include violation of labor rights and economic harm, fitting the definition of an AI Incident. There is direct harm caused by the AI system's use in managing driver status and employment-like conditions.