
The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
Chinese authorities have launched a four-month nationwide campaign to address the proliferation of AI-generated harmful content targeting minors, including toxic animations, inappropriate AI personas, and algorithm-driven recommendations. These AI systems have caused psychological harm, privacy violations, and exposure to inappropriate material among children, prompting regulatory intervention to protect minors online.[AI generated]
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI technology being used to create 'toxic animations' that distort classic cartoons with violent and inappropriate content targeting children, which constitutes direct harm to their mental health and well-being. It also discusses AI-enabled algorithmic recommendation systems that precisely target minors with harmful content, amplifying the impact. The harms include psychological injury to children and violations of their rights to safe content. The regulatory response is a societal governance measure addressing these harms but does not negate the fact that the AI systems' misuse has already caused harm. Hence, this qualifies as an AI Incident because the AI systems' use has directly led to harm to a vulnerable population.[AI generated]