AI-Morphed Image of Woman Used Without Consent at Delhi Protest

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A 25-year-old woman in Delhi alleged her photograph was manipulated using AI face-swapping tools and displayed alongside Prime Minister Modi's image during a Cockroach Janta Party protest at Jantar Mantar. The unauthorized, AI-generated image was publicly exhibited and circulated online, leading to reputational harm and an FIR under cybercrime laws.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event explicitly mentions the use of AI face-swapping tools to create a morphed image without consent, which was publicly displayed and spread, causing psychological harm to the woman. This fits the definition of an AI Incident as the AI system's use directly led to harm to a person and a violation of rights. The involvement of AI in generating the manipulated image is clear, and the harm is realized, not just potential. Therefore, the classification is AI Incident.[AI generated]
AI principles
Privacy & data governanceRespect of human rights

Industries
Media, social platforms, and marketing

Affected stakeholders
Women

Harm types
Reputational

AI system task:
Content generation


Articles about this incident or hazard