AI-Generated Misinformation Causes Social Harm and Legal Action in China

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

In China, AI-generated fake news and images have been used to spread misinformation about disasters, including earthquakes and floods, leading to public confusion, panic, and disruption of social order. Authorities have taken legal action against individuals who used AI tools to fabricate and disseminate false information online.[AI generated]

Why's our monitor labelling this an incident or hazard?

An AI system was explicitly involved as the user queried an AI software to generate text related to the earthquake, which was then spread as false information. This use of AI directly led to the spread of misinformation, which constitutes harm to communities and public order, fitting the definition of an AI Incident. The event involves the use and misuse of an AI system leading to realized harm, not just potential harm or complementary information.[AI generated]
AI principles
SafetyTransparency & explainability

Industries
Media, social platforms, and marketing

Affected stakeholders
General public

Harm types
PsychologicalPublic interest

AI system task:
Content generation


Articles about this incident or hazard