Nepal Urges Meta and TikTok to Remove Harmful AI-Generated Flood Content

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Following devastating flash floods, Nepalese authorities requested Meta and TikTok to swiftly remove AI-generated videos, misleading posts, and fraudulent donation QR codes that misinformed the public, hampered relief efforts, and distressed victims' families. Officials also urged the platforms to improve their algorithms for detecting deceptive AI content.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article clearly states that AI-generated videos and images are being circulated as real disaster footage, misleading the public and harming rescue efforts and victims' families. This meets the definition of an AI Incident because the AI system's use (generation of misleading content) has directly led to harm to communities and individuals. The government's regulatory response and coordination with platforms to remove such content is a societal/governance response, which is complementary information. Since the main narrative is about the ongoing harm caused by AI-generated misinformation and the government's efforts to address it, the classification is AI Incident.[AI generated]
AI principles
AccountabilityRobustness & digital security

Industries
Media, social platforms, and marketing

Affected stakeholders
General public

Harm types
Economic/PropertyPsychologicalPublic interest

AI system task:
Content generation


Articles about this incident or hazard