Amazon Prime Air Exits Drone Alliance Over AI Safety Dispute

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Amazon Prime Air withdrew from the Commercial Drone Alliance, citing safety concerns over the group's opposition to mandatory AI-based detect-and-avoid technology in drones. Amazon highlighted that its AI system had prevented two potential mid-air collisions, warning that lack of such standards could risk catastrophic accidents.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves AI systems (detect-and-avoid technology in drones) that have successfully prevented potential catastrophic collisions, indicating AI system use and its critical role in safety. Although no harm has occurred, the disagreement over safety standards and the potential consequences of not adopting such technology represent a credible risk of future harm. Therefore, this qualifies as an AI Hazard because it plausibly could lead to harm if safety concerns are not adequately managed. It is not an AI Incident since no harm has materialized, nor is it merely complementary information or unrelated news.[AI generated]
AI principles
SafetyRobustness & digital security

Industries
Mobility and autonomous vehiclesLogistics, wholesale, and retail

Affected stakeholders
General public

Harm types
Physical (injury)Physical (death)

Business function:
Logistics

AI system task:
Recognition/object detectionGoal-driven organisation


Articles about this incident or hazard