AI Chatbot Claude Cites Russian Disinformation Sources in News Responses

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A study by Agora Digitale Transformation found that AI chatbots, especially Claude by Anthropic, have cited manipulated content from a Russian disinformation network as legitimate news sources. This has led to the spread of misinformation, raising concerns about AI-driven bias and transparency in news dissemination in Germany.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves AI systems (chatbots) whose use has directly led to harm in the form of misinformation and biased information dissemination, which affects public opinion and informed decision-making (harm to communities). The study documents actual occurrences of biased and disinformation sources being cited by AI chatbots, not just potential risks. The lack of transparency and the 'blackbox' nature of these systems exacerbate the harm. Therefore, this is an AI Incident as the AI systems' outputs have directly caused harm through misinformation and political bias.[AI generated]
AI principles
FairnessTransparency & explainability
Industries
Media, social platforms, and marketing
Affected stakeholders
ConsumersGeneral public
Harm types
Public interest
Severity
AI incident
Business function:
Citizen/customer service
AI system task:
Interaction support/chatbots

Articles about this incident or hazard