Amazon Drone Delivery AI Malfunctions Lead to Property Damage and Regulatory Scrutiny

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Amazon's Prime Air drone delivery service, powered by AI, has experienced several malfunctions, including drones dropping packages into pools, colliding with cranes, and snapping internet cables. These incidents have caused property damage and triggered regulatory investigations in the US and UK, highlighting risks as Amazon rapidly expands drone operations to 500 US cities.[AI generated]

Why's our monitor labelling this an incident or hazard?

The drones are AI systems used for autonomous delivery. The event involves the planned use of these AI systems, but no incident or harm has occurred. The concerns about privacy and noise are potential issues that could plausibly lead to harm, such as privacy violations or community disruption, but these remain speculative at this stage. The event does not describe an actual AI Incident or Complementary Information about a past incident, nor is it solely a beneficial use countering external harm. Hence, it fits the definition of an AI Hazard, as the development and deployment of AI-powered drones could plausibly lead to harms in the future.[AI generated]
AI principles
SafetyRobustness & digital security

Industries
Mobility and autonomous vehiclesRobots, sensors, and IT hardware

Affected stakeholders
ConsumersGeneral public

Harm types
Economic/Property

Business function:
Logistics

AI system task:
Goal-driven organisationRecognition/object detection


Articles about this incident or hazard