Amazon Drone Delivery Malfunctions Lead to Packages Dropped in Pools

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Amazon's autonomous delivery drones have repeatedly malfunctioned, dropping packages into customers' swimming pools and ponds, notably in Texas and Arizona. These incidents, captured on video, resulted in property damage and customer dissatisfaction, highlighting operational flaws in Amazon's Prime Air AI-driven delivery system as it expands across the U.S.[AI generated]

Why's our monitor labelling this an incident or hazard?

The delivery drone is an AI system performing autonomous delivery. The package being dropped into the pool and damaged constitutes harm to property. The event is a direct consequence of the AI system's malfunction or operational failure. Therefore, it meets the criteria for an AI Incident due to harm caused by the AI system's use.[AI generated]
AI principles
AccountabilitySafety

Industries
Logistics, wholesale, and retailMobility and autonomous vehicles

Affected stakeholders
Consumers

Harm types
Economic/Property

Business function:
Logistics

AI system task:
Recognition/object detectionGoal-driven organisation


Articles about this incident or hazard