AI-Generated Disturbing Videos Harm Children's Mental Health in China

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

AI systems are being used to generate and spread disturbing, violent, and culturally distorting videos and images, widely consumed by children in China. These "AI-modified" contents, often algorithmically recommended, have led to psychological harm, confusion about traditional culture, and parental concern, highlighting failures in content moderation and platform responsibility.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves AI-generated content (AI system involvement) that is widely disseminated and consumed by children, leading to concerns about mental and cultural harm. The harm is indirect but plausible and significant, as psychological experts warn about the negative impact on children's mental health and cultural perception. This fits the definition of an AI Incident because the AI system's use has directly or indirectly led to harm to a group of people (children) in terms of mental health and cultural understanding. The article does not describe a future risk but an ongoing situation with realized harm potential, so it is not merely a hazard or complementary information.[AI generated]
AI principles
SafetyAccountabilityHuman wellbeingTransparency & explainabilityRobustness & digital security

Industries
Media, social platforms, and marketing

Affected stakeholders
Children

Harm types
PsychologicalPublic interest

Severity
AI incident

Business function:
Other

AI system task:
Content generationOrganisation/recommenders


Articles about this incident or hazard

Thumbnail Image

怪异"AI山海经"流行,当心孩子沉迷"毒流量"

2025-11-24
凤凰网(凤凰新媒体)
Why's our monitor labelling this an incident or hazard?
The event involves AI-generated content (AI system involvement) that is widely disseminated and consumed by children, leading to concerns about mental and cultural harm. The harm is indirect but plausible and significant, as psychological experts warn about the negative impact on children's mental health and cultural perception. This fits the definition of an AI Incident because the AI system's use has directly or indirectly led to harm to a group of people (children) in terms of mental health and cultural understanding. The article does not describe a future risk but an ongoing situation with realized harm potential, so it is not merely a hazard or complementary information.
Thumbnail Image

家长请注意!小学生沉迷的"外国山海经""奥特曼怀孕"等邪典视频卷土重来,内容诡异、暴力,背后谁在"作妖"? 2025-11-23 18:53

2025-11-23
每日经济新闻
Why's our monitor labelling this an incident or hazard?
The event involves AI systems generating and distributing harmful content that is directly affecting children by exposing them to violent, disturbing, and culturally degrading material. The AI's role in content creation and algorithmic recommendation is pivotal in causing this harm. The harm is realized and ongoing, including psychological harm to children and cultural harm through distortion of traditional culture. The article details the direct negative impact on minors and the failure of platforms to effectively block such content, confirming the presence of an AI Incident rather than a mere hazard or complementary information.
Thumbnail Image

"赛博山海经"风靡网络,"AI邪典"如何影响儿童心理健康?

2025-11-24
华龙网
Why's our monitor labelling this an incident or hazard?
The event involves AI-generated videos that are widely consumed by children, leading to concerns about psychological harm such as attention fragmentation and impaired cognitive abilities. The AI system's role in generating this content is central to the harm described. The harm is realized and ongoing, as children are actively engaging with this content and exhibiting negative effects. This fits the definition of an AI Incident because the AI system's use has directly or indirectly led to harm to a group of people (children's mental health).
Thumbnail Image

警惕AI"魔改"伤了文化根脉

2025-11-24
大江网
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems to generate or modify cultural content in ways that have already led to harm, particularly to communities and cultural heritage, as well as to the mental and moral development of minors. The AI-generated content includes violent and low-quality material that is being disseminated widely, influencing vulnerable groups. This constitutes harm to communities and cultural property, fitting the definition of an AI Incident. The article also discusses the need for legal and technical responses, but the primary focus is on the realized harm caused by AI-generated content, not just potential future harm or general commentary.
Thumbnail Image

警惕AI"邪典视频"对孩子们"投毒"

2025-11-22
k.sina.com.cn
Why's our monitor labelling this an incident or hazard?
The event involves AI systems explicitly in the generation and dissemination of harmful video content targeting children, causing realized harm to their mental health and cultural development (harm to communities and individuals). The AI systems' use and misuse in content creation and algorithmic recommendation directly contribute to the harm. The article details ongoing harm rather than potential harm, and the AI's role is pivotal in enabling the production and spread of these harmful videos. Hence, it meets the criteria for an AI Incident rather than a hazard or complementary information.
Thumbnail Image

AI邪典视频正对孩子精神投毒 律师解读外国山海经等AI魔改视频危害

2025-11-23
k.sina.com.cn
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI-modified videos spreading harmful content to children, causing mental harm and potential behavioral risks. The AI system's use in generating or altering these videos is directly linked to the harm described. This fits the definition of an AI Incident because the AI system's use has directly led to harm to a vulnerable group (children), impacting their health and well-being. The presence of a profit chain and calls for regulatory action further support the seriousness and realized nature of the harm.
Thumbnail Image

迷上"外国山海经",满嘴诡异咒语?别让"AI邪典"带偏了童年

2025-11-24
新浪财经
Why's our monitor labelling this an incident or hazard?
The event involves AI systems generating content that is consumed by children, leading to negative psychological effects and cultural confusion. The AI-generated videos and toys are causing children to adopt strange, meaningless language and be exposed to violent or disturbing content, which can harm their mental health and cultural understanding. The harm is realized and ongoing, not merely potential. The article explicitly links the AI-generated content to these harms, fulfilling the criteria for an AI Incident. The involvement of AI in content generation and the direct impact on children's well-being justifies this classification.
Thumbnail Image

人民日报评AI邪典视频乱象:警惕AI"邪典视频"对孩子们"投毒"

2025-11-22
news.bjd.com.cn
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems to generate harmful video content that is actively spreading and causing psychological harm to children, which qualifies as harm to communities and individuals' mental health. The AI system's use in producing and disseminating this content directly leads to harm. Therefore, this is an AI Incident as the AI system's use has directly led to significant harm to a vulnerable group (children).
Thumbnail Image

迷上"外国山海经",满嘴诡异咒语?别让"AI邪典"带偏了童年

2025-11-24
news.bjd.com.cn
Why's our monitor labelling this an incident or hazard?
The event involves AI systems generating distorted and harmful content that children consume and imitate, leading to psychological and cultural harm. The AI-generated videos and related products have directly led to negative impacts on children's mental health, cultural perception, and social interactions, fulfilling the criteria for harm to communities and groups of people. The AI system's use is explicit and central to the harm described. Hence, this is an AI Incident rather than a hazard or complementary information, as the harm is occurring and not merely potential or a response to past events.