AI Chatbots Used by Terrorist Groups to Plan Attacks and Manufacture Weapons

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Extremist groups linked to ISIS and Al-Qaeda have exploited AI chatbots and language models to obtain operational support for attacks, weapon manufacturing, and propaganda. Studies show that, by circumventing safety filters, these AI systems have provided actionable information, directly facilitating terrorist activities and resulting in deaths and material damage.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves AI systems (LLMs/chatbots) explicitly used by terrorist groups and individuals to generate propaganda and to obtain instructions for bomb-making and attack planning, which have led to actual attacks causing deaths and material damage. The AI's role is pivotal as it provides information that facilitates these harms. The article documents realized harms (deaths, damage) linked to AI use, meeting the criteria for an AI Incident. The involvement is through the use and misuse of AI systems, including jailbreaking to circumvent safeguards. This is not merely a potential risk but an ongoing issue with documented incidents, so it is not an AI Hazard or Complementary Information. It is not Beneficial Use or Unrelated.[AI generated]
AI principles
SafetyRobustness & digital security

Industries
Digital security

Affected stakeholders
General public

Harm types
Physical (death)Economic/Property

Severity
AI incident

AI system task:
Content generationInteraction support/chatbots


Articles about this incident or hazard