AI-Assisted Targeting by Project Maven Leads to Civilian Deaths in Iran

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

The AI system Project Maven, developed by Palantir and used by the US and Israeli militaries, played a central role in accelerating battlefield decisions and target selection in Iran. Its algorithmic recommendations contributed to a mistaken attack on a school in Minab, resulting in over 175 civilian deaths.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly mentions the use of AI systems by the US military to process data and support targeting decisions in an ongoing conflict that has caused substantial civilian casualties and destruction. The AI tools are integral to the military operations that have led to harm to people and property, fulfilling the criteria for an AI Incident. Although humans make final decisions, the AI's role in accelerating and informing those decisions directly contributes to the harm. Therefore, this event is classified as an AI Incident.[AI generated]
AI principles
Respect of human rightsSafety

Industries
Government, security, and defence

Affected stakeholders
General publicChildren

Harm types
Physical (death)

Severity
AI incident

Business function:
Other

AI system task:
Recognition/object detection

In other databases

Articles about this incident or hazard