AI-Generated Deepfakes Fuel Disinformation During CJP Protests in Maharashtra

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Maharashtra Cyber Police identified over 500 social media profiles, many linked to Pakistan and other countries, using AI-generated deepfakes and manipulated content to spread disinformation during the CJP protests. The coordinated campaign aimed to mislead the public and disrupt social order, prompting authorities to block hundreds of accounts and posts.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event explicitly mentions AI-generated and AI-assisted content being used to spread misleading information and provoke unrest, which directly harms communities by disturbing public order. The involvement of AI systems in generating synthetic voices, cloned audio, and digitally manipulated videos is clear. The harm is realized and ongoing, as evidenced by legal actions and FIRs registered. Therefore, this qualifies as an AI Incident due to the direct link between AI-generated content and social harm.[AI generated]
AI principles
Democracy & human autonomyRobustness & digital security

Industries
Media, social platforms, and marketingDigital security

Affected stakeholders
General public

Harm types
Public interest

AI system task:
Content generation


Articles about this incident or hazard