
The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
AI-generated digital personas, such as "AI Xiaohai," are being used on Chinese short video platforms to emotionally manipulate elderly users into purchasing overpriced goods. These AI-driven accounts simulate hardship narratives to gain sympathy and drive sales, resulting in financial and emotional harm to vulnerable consumers.[AI generated]
Why's our monitor labelling this an incident or hazard?
The article clearly identifies AI systems generating digital human personas used to deceive and emotionally manipulate elderly consumers into buying overpriced goods, constituting direct harm to these individuals (financial and emotional harm). The AI's role is pivotal as it automates the creation and dissemination of these deceptive narratives at scale, enabling widespread exploitation. This fits the definition of an AI Incident because the AI system's use has directly led to violations of consumer rights and harm to a vulnerable community. The presence of AI is explicit, the harm is realized, and the event involves misuse of AI for fraudulent commercial gain.[AI generated]