Defense Distributed Launches 'GatGPT', an Unfiltered Firearms-Focused AI Chatbot

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Defense Distributed, led by Cody Wilson, has released 'GatGPT', an AI chatbot trained on firearms data and designed without standard safety filters. Promoted as a 'Digital Second Amendment' tool, its uncensored nature raises concerns about potential future harm from unregulated or dangerous information dissemination, though no incidents have yet occurred.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly mentions an AI system (GatGPT chatbot) designed without safety filters and with a political agenda to avoid content moderation. Although no direct harm is reported, the removal of safety constraints in an AI system that can generate content, especially with firearm-related data, plausibly could lead to harms such as misinformation, incitement, or other societal harms. This fits the definition of an AI Hazard, as the AI system's use could plausibly lead to an AI Incident in the future. There is no indication that harm has already occurred, so it is not an AI Incident. The article is not merely complementary information or unrelated news, as it focuses on the release of a potentially harmful AI system.[AI generated]
AI principles
SafetyRobustness & digital securityAccountabilityRespect of human rightsTransparency & explainabilityHuman wellbeingDemocracy & human autonomy

Industries
Government, security, and defenceDigital securityMedia, social platforms, and marketing

Affected stakeholders
General public

Harm types
Physical (injury)Physical (death)Public interestHuman or fundamental rights

Business function:
Other

AI system task:
Interaction support/chatbotsContent generation


Articles about this incident or hazard