Food Delivery Platform Algorithms Cause Harm to Riders and Consumers

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

AI-driven algorithms used by food delivery platforms like Meituan and Ele.me pressure riders to meet strict delivery times, leading to unsafe driving, accidents, and stress. Consumers also suffer from late, incorrect, or tampered deliveries, and sometimes face abuse from riders, highlighting widespread harm caused by these algorithmic systems.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly discusses the use of algorithmic systems by food delivery platforms to manage and optimize delivery times. These algorithms are AI systems as they infer from input data (orders, locations, time constraints) to generate outputs (delivery schedules, time estimates) that influence real-world outcomes. The harms described include consumer health injury (food poisoning from tampered food), violations of consumer rights (misdelivery, unfair waiting times), and psychological harm (abuse and threats from riders). The AI system's pressure on riders to meet strict delivery times leads to these negative outcomes, showing a direct causal link. Hence, this is an AI Incident, not merely a hazard or complementary information.[AI generated]
AI principles
SafetyHuman wellbeingAccountabilityRespect of human rights

Industries
Food and beveragesLogistics, wholesale, and retail

Affected stakeholders
WorkersConsumers

Harm types
Physical (injury)PsychologicalEconomic/Property

Severity
AI incident

Business function:
Logistics

AI system task:
Goal-driven organisation


Articles about this incident or hazard

Thumbnail Image

被困在系统里的,还有点外卖的人 - cnBeta.COM 移动版

2020-10-25
cnBeta.COM
Why's our monitor labelling this an incident or hazard?
The article explicitly discusses the use of algorithmic systems by food delivery platforms to manage and optimize delivery times. These algorithms are AI systems as they infer from input data (orders, locations, time constraints) to generate outputs (delivery schedules, time estimates) that influence real-world outcomes. The harms described include consumer health injury (food poisoning from tampered food), violations of consumer rights (misdelivery, unfair waiting times), and psychological harm (abuse and threats from riders). The AI system's pressure on riders to meet strict delivery times leads to these negative outcomes, showing a direct causal link. Hence, this is an AI Incident, not merely a hazard or complementary information.
Thumbnail Image

被困在系统里的,还有点外卖的人

2020-10-25
tmtpost.com
Why's our monitor labelling this an incident or hazard?
The article explicitly discusses the role of platform algorithms (AI systems) in pressuring delivery riders to speed and violate traffic laws, leading to increased accidents and rider harm. It also details consumer harms such as late or incorrect deliveries and abusive behavior from riders, all linked to the AI-driven system's optimization and enforcement of delivery times. The harms are realized and ongoing, fulfilling the criteria for an AI Incident. The AI system's development and use directly and indirectly cause these harms, making this classification appropriate.
Thumbnail Image

被困在系统里的,还有点外卖的人

2020-10-26
Baidu.com
Why's our monitor labelling this an incident or hazard?
The article explicitly discusses the role of platform algorithms (AI systems) in managing delivery riders, which leads to unsafe behaviors and increased accidents (harm to health), as well as consumer harm through late or incorrect deliveries and abusive behavior (harm to consumers and violation of rights). The AI system's use in optimizing delivery times and enforcing strict rules is a direct contributing factor to these harms. Therefore, this qualifies as an AI Incident because the AI system's use has directly and indirectly led to multiple harms as defined in the framework.
Thumbnail Image

被困在系统里的,还有点外卖的人

2020-10-25
新浪财经
Why's our monitor labelling this an incident or hazard?
The article explicitly discusses the platform's algorithmic system that schedules and pressures delivery riders, leading to unsafe behaviors and accidents (harm to health), delivery errors and consumer complaints (harm to consumers and violation of consumer rights), and even cases of food tampering causing illness (harm to health). The AI system's use and its effects are central to the harms described, fulfilling the criteria for an AI Incident. The harms are realized, not just potential, and the AI system's role is pivotal in causing these harms.
Thumbnail Image

半月谈:别让"打工人"消失在数字帝国里 - cnBeta.COM 移动版

2020-11-13
cnBeta.COM
Why's our monitor labelling this an incident or hazard?
The article explicitly describes how algorithmic systems used by delivery and platform companies regulate workers' behavior, leading to unsafe practices (e.g., traffic violations) and labor rights violations (e.g., lack of social security, unreasonable delivery times). These harms are directly linked to the AI systems' use in managing and optimizing worker performance. The harms include injury risk to workers (a), violations of labor rights (c), and harm to communities through unsafe delivery practices (d). Hence, the event meets the criteria for an AI Incident due to the realized harms caused by AI system use in platform labor management.
Thumbnail Image

半月谈:别让"打工人"消失在数字帝国里

2020-11-13
凤凰网(凤凰新媒体)
Why's our monitor labelling this an incident or hazard?
The article clearly involves AI systems in the form of algorithmic management platforms that control and optimize delivery workers' tasks and times. The harms described include labor rights violations and health/safety risks to workers, which are indirect harms caused by the AI system's use. However, the article does not report a single discrete incident but rather ongoing systemic harm and labor exploitation linked to AI-driven platforms. This fits the definition of an AI Incident because actual harm to people (workers) is occurring due to the AI system's use. The article also discusses responses and potential improvements but the primary focus is on the harm caused by AI systems in platform labor management.
Thumbnail Image

半月谈:别让"打工人"消失在数字帝国里

2020-11-13
新浪财经
Why's our monitor labelling this an incident or hazard?
The article explicitly describes AI systems (algorithms) used by platforms to manage and optimize delivery workers' tasks, which directly contribute to unsafe working conditions and labor rights issues. These harms fall under violations of labor rights and harm to workers' health and safety, caused indirectly by the AI system's use. Therefore, this qualifies as an AI Incident because the AI system's use has directly or indirectly led to harm to a group of people (platform workers).