DuckDuckGo AI Spreads False Trump Death Story After Reddit Data Poisoning

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

DuckDuckGo's AI search feature falsely reported that Donald Trump and JD Vance died of rabies, citing fabricated news. This misinformation resulted from a coordinated Reddit campaign (r/poisonai) that seeded fake stories online, exposing vulnerabilities in AI systems to data poisoning and raising concerns about AI-driven misinformation.[AI generated]

Why's our monitor labelling this an incident or hazard?

The AI system (DuckDuckGo's chatbot) produced a false and harmful output (claiming Donald Trump died of rabies) due to hallucination influenced by poisoned training or input data from a Reddit group. This false information was disseminated, including by a news channel, causing misinformation harm to the community. The AI's malfunction and use directly led to this harm, fitting the definition of an AI Incident. The article focuses on this realized harm rather than just potential or complementary information.[AI generated]
AI principles
Robustness & digital securityAccountability

Industries
Media, social platforms, and marketingDigital security

Affected stakeholders
General publicOther

Harm types
ReputationalPublic interest

Severity
AI incident

AI system task:
Content generationInteraction support/chatbots


Articles about this incident or hazard