AI-Generated Misinformation Causes Public Harm and Disrupts Disaster Response in China

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Multiple incidents across China involved individuals using AI tools to fabricate and spread false disaster and exam-related information online. These AI-generated rumors caused public panic, disrupted emergency and educational operations, and undermined trust in institutions. Authorities responded with administrative and criminal penalties against the perpetrators.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves the use of AI systems (AI-generated tools) to create and disseminate false flood and disaster information, which has directly caused harm by misleading the public and disrupting social order during a critical period. The harm includes social disruption and potential interference with emergency management, fitting the definition of harm to communities and violation of public order. Therefore, this is an AI Incident due to the realized harm caused by malicious AI-generated misinformation.[AI generated]
AI principles
AccountabilitySafety

Industries
Government, security, and defenceEducation and training

Affected stakeholders
General publicGovernment

Harm types
Public interestPsychologicalReputational

AI system task:
Content generation


Articles about this incident or hazard