AI Search Engines Fabricate News Citations, Undermining Publishers

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A study by the Tow Center found that eight AI-powered search engines and chatbots, including ChatGPT, Perplexity and Elon Musk’s Grok3, frequently misquote or fabricate news citations, remixing publisher content without credit and driving down traffic. Over 60% of responses contained wrong or broken links, undermining journalistic credibility.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly involves AI systems (chatbots like ChatGPT, Gemini, Grok 3) that autonomously generate responses based on web searches. The study demonstrates that these AI systems produce incorrect or fabricated information in a majority of cases, which constitutes misinformation. This misinformation can mislead users, causing harm to communities by spreading false or misleading information. The AI systems' use and malfunction (hallucination, fabrication) directly lead to this harm. Hence, the event meets the criteria for an AI Incident as it involves realized harm caused by AI system outputs.[AI generated]
AI principles
AccountabilityRobustness & digital securitySafetyTransparency & explainabilityRespect of human rightsDemocracy & human autonomy

Industries
Media, social platforms, and marketingIT infrastructure and hosting

Affected stakeholders
Business

Harm types
Economic/PropertyReputationalPublic interest

Business function:
Other

AI system task:
Content generationInteraction support/chatbotsOrganisation/recommenders


Articles about this incident or hazard