Google AI Overviews Spread Millions of Misinformation Answers Daily

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Google's AI Overviews, powered by Gemini models, generate factually incorrect or unsupported answers in about 9-15% of search results, leading to millions of misleading or erroneous responses daily. Studies by The New York Times and Oumi highlight both factual errors and unreliable source citations, raising concerns about large-scale misinformation.[AI generated]

Why's our monitor labelling this an incident or hazard?

Google's AI Overviews is an AI system generating search answer summaries. The report shows that the system produces a high volume of incorrect answers, which means users are receiving false information. This dissemination of false information is a form of harm to communities and individuals relying on the information, fulfilling the criteria for harm under the AI Incident definition. The event involves the use of the AI system and its outputs directly leading to harm. Hence, the classification is AI Incident.[AI generated]
AI principles
Robustness & digital securityTransparency & explainability

Industries
Media, social platforms, and marketing

Affected stakeholders
ConsumersGeneral public

Harm types
Public interest

AI system task:
Content generation


Articles about this incident or hazard