AI-Driven Combat Drones Deployed by U.S. Air Force; Autopilot Malfunction Causes Crash

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

The U.S. Air Force has deployed its first AI-powered autonomous combat drones, the FQ-42 Vengeance and FQ-44 Fury, under the Collaborative Combat Aircraft program. During testing, an autopilot miscalculation caused one drone to crash, highlighting the risks of AI malfunctions in military applications.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly discusses AI-enabled autonomous combat drones being developed and contracted for production by the U.S. Air Force. The AI system involvement is clear in the autonomy software that allows the drones to fly and operate independently. Although no incident of harm has occurred yet, the nature of the system and its intended use in military combat operations present a credible risk of significant harm in the future. The event is about the development and procurement of AI systems with high potential for misuse or harm, fitting the definition of an AI Hazard. There is no indication of realized harm or incident, so it is not an AI Incident. It is not complementary information or unrelated, and it is not a beneficial use since the AI system itself is a weapon system with inherent risk.[AI generated]
AI principles
SafetyRobustness & digital security

Industries
Government, security, and defence

Affected stakeholders
Government

Harm types
Economic/Property

AI system task:
Goal-driven organisation


Articles about this incident or hazard