Amazon's AI Driver Monitoring System Causes Worker Harm and Privacy Concerns

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Amazon has expanded its use of AI-powered cameras to monitor delivery drivers in the UK, following a US rollout that led to drivers being wrongly denied bonuses due to system errors. The AI system's surveillance and scoring have raised significant privacy and labor rights concerns, with reports of direct harm to workers.[AI generated]

Why's our monitor labelling this an incident or hazard?

The AI system (AI-powered cameras with real-time monitoring and scoring) is explicitly mentioned and is used in the operation of delivery vans. The system's use has directly led to harms including privacy violations, worker demoralization, and labor rights concerns, as evidenced by resignations and petitions against the surveillance. These harms fall under violations of human rights and labor rights, meeting the criteria for an AI Incident. The concerns about distraction and demoralization further support the presence of harm. Hence, the event is classified as an AI Incident.[AI generated]
AI principles
AccountabilityFairnessPrivacy & data governanceRespect of human rightsRobustness & digital securityTransparency & explainabilityHuman wellbeingSafety

Industries
Logistics, wholesale, and retail

Affected stakeholders
Workers

Harm types
Economic/PropertyPsychologicalHuman or fundamental rights

Severity
AI incident

Business function:
Monitoring and quality controlHuman resource management

AI system task:
Recognition/object detectionEvent/anomaly detection


Articles about this incident or hazard

Thumbnail Image

Amazon installs 'creepy' AI cameras to monitor more delivery drivers, report says.

2022-05-22
Yahoo News
Why's our monitor labelling this an incident or hazard?
The AI system (AI-powered cameras with real-time monitoring and scoring) is explicitly mentioned and is used in the operation of delivery vans. The system's use has directly led to harms including privacy violations, worker demoralization, and labor rights concerns, as evidenced by resignations and petitions against the surveillance. These harms fall under violations of human rights and labor rights, meeting the criteria for an AI Incident. The concerns about distraction and demoralization further support the presence of harm. Hence, the event is classified as an AI Incident.
Thumbnail Image

Amazon installs 'creepy' AI cameras to monitor more delivery drivers, report says.

2022-05-22
Business Insider
Why's our monitor labelling this an incident or hazard?
The AI system is explicitly mentioned as being used to monitor drivers, issue alerts, and score performance, which directly affects workers' pay and employment. The surveillance has caused harm to workers' privacy and labor rights, as evidenced by resignations and petitions. This fits the definition of an AI Incident because the AI system's use has directly led to violations of human rights and labor rights (harm category c). The concerns about distraction and demoralization further support harm to workers. Therefore, this event is classified as an AI Incident.
Thumbnail Image

Amazon installs AI-powered cameras in UK delivery vans

2022-05-23
Yahoo! Finance
Why's our monitor labelling this an incident or hazard?
The article involves an AI system (AI-powered cameras with behavior detection) used in a real-world setting. However, there is no indication that the AI system has directly or indirectly caused any harm such as injury, rights violations, or operational disruption. The concerns raised are about potential privacy and worker rights issues, but these are expressed as worries or objections rather than documented harms. Therefore, this event does not qualify as an AI Incident or AI Hazard. Instead, it provides contextual information about AI deployment and societal responses, fitting the definition of Complementary Information.
Thumbnail Image

Amazon installs AI cameras to monitor its delivery drivers

2022-05-22
The Telegraph
Why's our monitor labelling this an incident or hazard?
The AI system is clearly involved in monitoring and assessing driver behavior, which fits the definition of an AI system. The event stems from the use of this AI system. However, the article does not report any actual injury, rights violation, or other harm caused by the AI system's deployment. The concerns raised are about privacy and worker rights, which are important but have not been documented as breached or harmed in this case. Therefore, this event does not meet the threshold for an AI Incident. It also does not describe a plausible future harm scenario beyond general concerns, so it is not an AI Hazard. The article mainly provides information about the deployment and societal reactions, making it Complementary Information.
Thumbnail Image

Amazon snooping on delivery drivers while they work with 'creepy' AI cameras

2022-05-23
Daily Star
Why's our monitor labelling this an incident or hazard?
The AI system is clearly involved in monitoring and alerting driver behavior, which fits the definition of an AI system. The event stems from the use of this AI system. However, the article does not report any direct or indirect harm caused by the AI system's use, only criticism and concerns about privacy and worker rights. Since no actual harm or incident is described, but there is a plausible risk of harm to privacy and worker rights, this qualifies as an AI Hazard rather than an AI Incident. It is not Complementary Information because the article focuses on the surveillance practice itself and the associated concerns, not on responses or updates to a prior incident. It is not Unrelated because the AI system is central to the event.
Thumbnail Image

Now Amazon to put 'creepy' AI cameras in UK delivery vans

2022-05-24
TheRegister.com
Why's our monitor labelling this an incident or hazard?
The AI system is explicitly mentioned as being used to monitor drivers via machine-learning algorithms analyzing behavior, which directly affects drivers' bonuses and pay. The system's errors have already caused harm by unfairly deducting bonuses, and the intrusive surveillance raises concerns about workers' rights and privacy violations. This fits the definition of an AI Incident because the AI system's use has directly led to harm related to labor rights and privacy breaches.
Thumbnail Image

Amazon installs 'creepy' AI cameras to monitor more delivery drivers, report says.

2022-05-22
Business Insider Nederland
Why's our monitor labelling this an incident or hazard?
The AI system (AI-powered cameras with real-time monitoring and scoring) is explicitly mentioned and is used in the operation of delivery vans. Its use has directly led to harms including privacy violations, negative impacts on workers' rights, and at least one resignation, which constitutes harm to persons and violations of labor rights. Therefore, this qualifies as an AI Incident under the framework because the AI system's use has directly led to realized harm to individuals and groups, including breaches of labor rights and privacy.
Thumbnail Image

Amazon installs AI-powered cameras in UK delivery vans (Steve Dent/Engadget)

2022-05-23
Tech Investor News
Why's our monitor labelling this an incident or hazard?
The event involves AI systems (AI-powered cameras with detection and alert capabilities) used in the monitoring of delivery drivers. However, the article describes the installation and use of these systems without reporting any direct or indirect harm resulting from their use. The concerns raised by privacy groups indicate potential issues but do not describe actual violations or harms occurring. Therefore, this situation represents a plausible risk or concern related to AI use but no realized harm or incident has been reported, classifying it as Complementary Information regarding societal and privacy implications of AI deployment.
Thumbnail Image

Amazon to bring AI driver monitoring to the UK

2022-05-24
Reclaim The Net
Why's our monitor labelling this an incident or hazard?
The AI system is explicitly mentioned as being used to monitor driver behavior and compute scores that impact pay, which has already caused harm in the US through wrongful denial of bonuses. The privacy and workers' rights concerns indicate violations of rights and harm to individuals. Since the AI system's use has directly led to harm, this qualifies as an AI Incident rather than a hazard or complementary information.