AI-Generated Fake News Causes Public Panic and Police Action in China

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Individuals in China used AI tools to fabricate and spread fake news and videos about a cruise ship accident and traffic incidents, causing public panic and disrupting social order. Authorities quickly identified and penalized the perpetrators, highlighting the risks of AI-generated misinformation and the need for stronger regulation and public awareness.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves AI systems explicitly used to generate fake news and videos that falsely report serious accidents, causing harm to communities by spreading misinformation and disrupting social order. The harm is realized, not just potential, as the fake news caused public concern and required police intervention. Therefore, this qualifies as an AI Incident because the AI system's use directly led to violations of social order and harm to communities through misinformation.[AI generated]
AI principles
Transparency & explainabilityRobustness & digital securitySafetyAccountabilityDemocracy & human autonomyHuman wellbeing

Industries
Media, social platforms, and marketingGovernment, security, and defenceTravel, leisure, and hospitalityMobility and autonomous vehiclesDigital security

Affected stakeholders
General public

Harm types
Public interestPsychological

Severity
AI incident

AI system task:
Content generation


Articles about this incident or hazard

Thumbnail Image

游船侧翻、交通事故?这些都是用AI编造的假新闻!

2025-07-27
news.cctv.com
Why's our monitor labelling this an incident or hazard?
The event involves AI systems explicitly used to generate fake news and videos that falsely report serious accidents, causing harm to communities by spreading misinformation and disrupting social order. The harm is realized, not just potential, as the fake news caused public concern and required police intervention. Therefore, this qualifies as an AI Incident because the AI system's use directly led to violations of social order and harm to communities through misinformation.
Thumbnail Image

央视通报多起AI炮制假新闻 虚假信息扰乱社会秩序

2025-07-27
中华网科技公司
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of AI tools to fabricate false news and videos that caused social disruption, which fits the definition of an AI Incident due to harm to communities (disruption of social order). The AI system's use in generating false information directly led to these harms, and law enforcement actions confirm the realized impact. Therefore, this event qualifies as an AI Incident.
Thumbnail Image

游船倒扣江中30人坠江?谣言 虚假图片迷惑网友

2025-07-28
中华网科技公司
Why's our monitor labelling this an incident or hazard?
The event describes the malicious use of AI-generated images and fabricated information to spread false news, which is a misuse of AI technology. However, since the false incident did not actually happen and no real harm occurred, it does not qualify as an AI Incident. It also does not represent a plausible future harm scenario but rather a realized misuse that was quickly addressed. Therefore, it is best classified as Complementary Information because it provides context on AI misuse, detection methods, and law enforcement response, enhancing understanding of AI-related risks and mitigation without reporting a new incident or hazard.
Thumbnail Image

早报|iPhone 17 Pro 或配备 8 倍光学变焦/廉价版特斯拉 Model Y 内饰曝光/宇树创始人回应「机器人跳舞拳击没用」

2025-07-28
爱范儿
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI systems being used to generate false news and videos that caused social disruption and required law enforcement action, which fits the definition of an AI Incident due to harm to communities and social order. The involvement of AI in these harms is direct and confirmed by investigations and penalties. Other content about Tesla's Robotaxi, AI glasses, and leadership changes are informative but do not describe new harms or plausible future harms, thus classified as Complementary Information. The priority is given to the AI Incident regarding AI-generated fake news and videos.
Thumbnail Image

游船侧翻、交通事故?这些都是用AI编造的假新闻!

2025-07-27
金羊网
Why's our monitor labelling this an incident or hazard?
The event involves AI systems explicitly used to generate false news and videos that have directly led to harm by disturbing social order and causing public panic. The harm is realized, not just potential, as the fake news and videos have been spread and caused societal disruption. This fits the definition of an AI Incident because the AI's use in fabricating and spreading misinformation has directly led to harm to communities and social order. The authorities' response and punishment are complementary information but do not change the classification of the event itself as an AI Incident.
Thumbnail Image

三层游船倒扣江中30人坠江系AI假新闻

2025-07-27
k.sina.com.cn
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI to generate false information (AI-generated fake news) that could potentially cause harm by misleading the public. However, since the false incident did not actually happen and no direct or indirect harm materialized, this does not qualify as an AI Incident. Instead, it represents a situation where AI-generated content could plausibly lead to harm if believed or spread further, but in this case, the harm was averted by prompt investigation and correction. Therefore, it is best classified as Complementary Information, as it provides context on AI misuse and the response by authorities rather than reporting an actual AI Incident or Hazard.
Thumbnail Image

游船侧翻、交通事故?央视通报多起 AI 炮制假新闻

2025-07-27
k.sina.com.cn
Why's our monitor labelling this an incident or hazard?
The article explicitly states that AI tools were used to fabricate false news and videos that misled the public about serious accidents, causing social disruption. The harm is realized, not just potential, as the fake news spread and required police intervention. This fits the definition of an AI Incident because the AI system's use directly led to harm to communities through misinformation and social disorder. The involvement of AI in creating the false content is clear and central to the event.
Thumbnail Image

游船侧翻、交通事故?这些都是用AI编造的假新闻!

2025-07-27
k.sina.com.cn
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems to create and spread false information (fake news and videos) that directly led to harm in the form of social disruption and potential public panic, which qualifies as harm to communities. The AI-generated content was deliberately used to mislead and cause disturbance, fulfilling the criteria for an AI Incident. The article describes realized harm, not just potential harm, and the AI system's role is pivotal in causing this harm.
Thumbnail Image

长江游船倒扣18人下落不明?谣言 虚假图片迷惑公众

2025-07-29
中华网科技公司
Why's our monitor labelling this an incident or hazard?
The event explicitly involves an AI system used to create false images and fabricated news, which misled the public. This constitutes misuse of AI in spreading misinformation. However, since the incident is a hoax with no actual injury, property damage, or rights violation occurring, it does not meet the criteria for an AI Incident. Also, since the misinformation was debunked and the perpetrator penalized, and no ongoing or plausible future harm is described, it does not qualify as an AI Hazard. The main focus is on the societal and governance response to AI misuse and public advice on identifying AI-generated content, which fits the definition of Complementary Information.
Thumbnail Image

长江游船倒扣,18人下落不明?警方辟谣

2025-07-30
杭州网
Why's our monitor labelling this an incident or hazard?
The event involves an AI system used to generate false images and text that spread misinformation about a serious accident, causing public alarm. The AI-generated content directly led to harm in the form of misinformation and potential social disruption, which fits the definition of harm to communities. The authorities' investigation and administrative punishment confirm the incident's seriousness. Therefore, this is an AI Incident due to the AI system's malicious use causing harm through misinformation dissemination.
Thumbnail Image

游船侧翻、交通事故?这些都是用AI编造的假新闻!

2025-07-27
k.sina.com.cn
Why's our monitor labelling this an incident or hazard?
The event involves AI systems used maliciously to generate false content that has caused harm by misleading the public and disturbing social order, which constitutes harm to communities. Since the AI-generated content has already been disseminated and caused social disruption and fear, this qualifies as an AI Incident. The article describes realized harm due to the AI system's use in fabricating and spreading false information, not just a potential risk. Therefore, the classification is AI Incident.
Thumbnail Image

如何遏制人工智能"说谎"(深阅读)

2025-08-20
人民网
Why's our monitor labelling this an incident or hazard?
The article clearly describes realized harms caused by AI systems generating and spreading false information, which misleads the public and disrupts social order, thus constituting harm to communities. It references specific incidents where AI-generated misinformation led to administrative penalties and platform actions, indicating direct or indirect harm caused by AI use. Therefore, this qualifies as an AI Incident under the OECD framework, as the AI system's use has directly or indirectly led to harm. The article also discusses responses and governance measures, but the primary focus is on the harm caused and its mitigation, not just complementary information or potential hazards.
Thumbnail Image

只有拿出动真格的态度和手段,专项行动与制度保障"两手抓",持之以恒深化网络空间治理,让伤企"黑嘴"彻底"闭麦",企业才能聚精会神干事业、心无旁骛谋发展。

2025-08-20
南方网
Why's our monitor labelling this an incident or hazard?
While the article mentions the misuse of AI technology as one of the issues addressed by the 'Clear and Bright' actions, it does not describe any particular AI system malfunction, misuse, or harm caused by AI. The main content centers on societal and governance responses to online misinformation and defamation affecting businesses, including legal actions and regulatory measures. Therefore, this is best classified as Complementary Information, as it provides context and updates on governance and enforcement efforts related to AI and online harms, rather than reporting a new AI Incident or AI Hazard.
Thumbnail Image

山西忻州有车辆失联致10死2伤?假

2025-08-19
杭州网
Why's our monitor labelling this an incident or hazard?
The event describes the use of AI-generated images to spread false information, which is a misuse of AI technology. However, no actual harm (such as injury, death, or rights violations) occurred as a result of the AI system's use; the harm is related to misinformation and social disruption but is not materialized in this case. The main issue is the malicious use of AI-generated content to spread rumors, which is a concern but does not meet the threshold for an AI Incident or AI Hazard as no direct or plausible harm resulted. Therefore, this is best classified as Complementary Information about AI misuse and societal response (law enforcement action).
Thumbnail Image

"流量"不能这么要!编造"车辆失联、10人遇难"谣言者被拘

2025-08-20
金羊网
Why's our monitor labelling this an incident or hazard?
An AI system was explicitly involved in generating fake images used to fabricate a false incident causing social harm by misleading the public and disturbing social order. The harm has already occurred as the false information was disseminated and caused disruption. Therefore, this qualifies as an AI Incident due to the direct use of AI-generated content to cause harm to communities and social order.
Thumbnail Image

人民日报关注:如何遏制人工智能"说谎

2025-08-19
k.sina.com.cn
Why's our monitor labelling this an incident or hazard?
The article centers on the ongoing and realized harms caused by AI systems generating and spreading false information, which misleads the public and poses challenges to governance and social stability. It reports on actual administrative and legal actions taken against AI-generated misinformation, indicating that harm has already occurred. The AI systems involved are generative AI models producing false content, which directly contribute to misinformation harms affecting communities and potentially violating rights. Therefore, this event qualifies as an AI Incident due to the direct harm caused by AI-generated false information and the legal and regulatory responses to it.
Thumbnail Image

如何遏制人工智能"说谎"

2025-08-22
news.cn
Why's our monitor labelling this an incident or hazard?
The article clearly involves AI systems as it focuses on AI-generated false information and its societal impacts. It acknowledges that AI-generated misinformation causes harm to communities and challenges regulatory bodies, which aligns with the definition of AI Incidents. However, the article mainly reports on existing regulatory actions, legal frameworks, expert opinions, and technical measures to address these harms rather than describing a new or specific AI Incident or AI Hazard event. Therefore, it fits best as Complementary Information, providing context and updates on societal and governance responses to AI-related harms.
Thumbnail Image

破"AI谣言",护人工智能向善

2025-08-21
扬子网(扬子晚报)
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI systems generating false videos and news, which can cause harm to communities by spreading misinformation. However, it focuses on the governance, regulatory, and technical measures being implemented or proposed to address these issues rather than reporting a concrete incident or a specific imminent hazard. Therefore, it fits the definition of Complementary Information as it provides context and updates on societal and governance responses to AI misuse rather than describing a new AI Incident or AI Hazard.
Thumbnail Image

一本正经地胡说八道!如何遏制人工智能"说谎"

2025-08-22
news.bjd.com.cn
Why's our monitor labelling this an incident or hazard?
The article clearly describes realized harms caused by AI systems generating and spreading false information that misleads the public and causes social disruption. It references administrative and legal actions taken against individuals and entities involved in spreading AI-generated misinformation, indicating direct harm to communities and violations of legal norms. The involvement of AI systems in generating deceptive content and the resulting regulatory and enforcement responses fit the definition of an AI Incident, as the AI system's use has directly led to harm (misinformation, social disruption, legal violations). The article also discusses complementary measures and governance responses but the primary focus is on the harms already occurring and the responses to them, thus classifying it as an AI Incident rather than merely Complementary Information or AI Hazard.
Thumbnail Image

峨眉山人猴大战游客坠崖?猴王逼死妙龄少女?网警逐帧辟谣!

2025-08-22
金羊网
Why's our monitor labelling this an incident or hazard?
The event involves AI-generated fabricated content (AI-generated rumors) that could plausibly lead to social harm by causing public panic and misinformation. However, the article states that these are false rumors and no actual harm has occurred. The police have taken action against those spreading the misinformation, which is a governance response. Since no direct or indirect harm has materialized, but there is a credible risk of social disruption from the AI-generated falsehoods, this qualifies as Complementary Information about societal and governance responses to AI-generated misinformation rather than an AI Incident or AI Hazard.
Thumbnail Image

"峨眉山人猴大战游客坠崖"?混剪+AI谣言!多人被查处

2025-08-22
新浪财经
Why's our monitor labelling this an incident or hazard?
The event involves AI-generated fabricated rumors contributing to social harm (panic and misinformation), but the article describes the authorities' successful debunking and legal actions rather than an ongoing or new AI Incident causing direct or indirect harm. The AI system's role is in rumor fabrication, but the main focus is on the response and mitigation. Hence, it fits the definition of Complementary Information, providing updates on responses to AI-related misinformation rather than reporting a new AI Incident or AI Hazard.