BAE Systems Awarded Contracts to Develop AI-Enabled Military Autonomy for US Army

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

BAE Systems has secured multiple US Army contracts to develop AI-driven autonomy technologies for the Advanced Teaming Demonstration Program. These systems aim to enable manned-unmanned teaming and autonomous control of aircraft swarms, presenting future risks of harm if misused or malfunctioning in military operations, though no incidents have yet occurred.[AI generated]

Why's our monitor labelling this an incident or hazard?

The described system involves AI-enabled autonomy and automation for military drones, which are intended to operate in contested environments and assist in decision-making. While no harm has yet occurred, the development and deployment of such autonomous weapon systems plausibly pose significant risks of harm, including injury or death in conflict, escalation of warfare, and other military-related harms. Therefore, this event represents an AI Hazard due to the credible potential for future harm stemming from the AI system's use in autonomous military operations.[AI generated]
AI principles
SafetyRobustness & digital securityAccountabilityTransparency & explainabilityDemocracy & human autonomyRespect of human rights

Industries
Government, security, and defenceRobots, sensors, and IT hardware

Affected stakeholders
WorkersGeneral public

Harm types
Physical (injury)Physical (death)

Business function:
Research and development

AI system task:
Goal-driven organisationReasoning with knowledge structures/planning


Articles about this incident or hazard