AI-Driven Spam Campaigns Manipulate Reddit to Influence Chatbot Outputs

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Companies and marketing agencies are flooding Reddit, especially the r/biohackers subreddit, with promotional and fake posts to manipulate AI chatbots like ChatGPT and Google's AI search. This coordinated campaign distorts AI-generated answers, harms community trust, and poses risks to users relying on AI for health information.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly mentions AI agents used by marketing firms to flood Reddit with promotional content designed to influence AI chatbots' outputs. This manipulation harms the Reddit community by spreading inauthentic, promotional content, which degrades the quality of information and trust in the platform, a form of harm to communities. The AI systems' use is central to the incident, as the content is generated and deployed by AI agents and targeted to influence AI chatbots. Hence, the event meets the criteria for an AI Incident due to realized harm caused by AI system use.[AI generated]
AI principles
Robustness & digital securityTransparency & explainability

Industries
Media, social platforms, and marketing

Affected stakeholders
ConsumersGeneral public

Harm types
Public interestPsychological

Severity
AI incident

Business function:
Citizen/customer service

AI system task:
Content generation


Articles about this incident or hazard