Is your AI chatbot manipulating you? Subtly reshaping your opinions?
2026-05-12
The Conversation
The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
Multiple articles warn that generative AI chatbots, powered by large language models, can hyper-personalize persuasive messages using users’ private data. This capability poses significant risks of manipulation, emotional exploitation, and misinformation, though no concrete incidents of harm are reported yet. The articles highlight the plausible future harms of AI-driven persuasion.[AI generated]
Why's our monitor labelling this an incident or hazard?
The article clearly involves AI systems (large language models and chatbots) and discusses their use and potential misuse in personalized persuasion. However, it does not report an actual incident of harm or a concrete event where an AI system has caused injury, rights violations, or other harms. Instead, it focuses on the plausible risks and ethical challenges posed by these AI capabilities, emphasizing the potential for future harm. Therefore, this is best classified as an AI Hazard, as it plausibly could lead to AI Incidents involving manipulation, emotional harm, or privacy violations, but no specific harm has been documented in the article.[AI generated]