AI-Generated Misinformation Causes Harm to Businesses and Disaster Response in China

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

In China, AI-generated misinformation, including deepfakes and synthetic disaster content, has caused significant harm—damaging company reputations, affecting stock prices, and disrupting emergency response. Authorities have responded with legal actions, platform bans, and enhanced monitoring to combat the spread of AI-assisted rumors and protect public safety and business interests.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves the use of AI systems (AI tools for synthetic image and video generation) to create false disaster-related content that has directly led to harm by disrupting emergency response and public safety. This constitutes a violation of public safety and can be considered harm to communities and individuals. Since the AI-generated misinformation has already caused harm and legal actions are underway, this qualifies as an AI Incident rather than a hazard or complementary information.[AI generated]
AI principles
Transparency & explainabilitySafety

Industries
Financial and insurance servicesGovernment, security, and defence

Affected stakeholders
BusinessGeneral public

Harm types
ReputationalEconomic/PropertyPublic interest

AI system task:
Content generation


Articles about this incident or hazard