Delhi High Court Orders Removal of AI-Generated Deepfakes Impersonating Kriti Sanon

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

The Delhi High Court ordered online platforms to remove AI-generated deepfakes and impersonation content targeting actor Kriti Sanon, including sexually explicit material and unauthorized chatbots. The court recognized harm to Sanon's privacy, dignity, and commercial interests, restraining further creation and dissemination of such AI-generated content.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly mentions AI-generated content (images, videos, audio, chatbots, voice models) used to impersonate and defame the actor, causing harm to her personality rights and dignity. The misuse of AI to create sexually explicit and morphed content that is publicly circulated constitutes a violation of fundamental rights and harms the individual. The court's intervention confirms that harm has occurred and is ongoing, directly linked to the AI system's outputs. Hence, this is an AI Incident involving violations of human rights and harm to the individual through AI misuse.[AI generated]
AI principles
Respect of human rightsPrivacy & data governance

Industries
Media, social platforms, and marketing

Affected stakeholders
Women

Harm types
Human or fundamental rightsEconomic/PropertyPsychological

AI system task:
Content generation


Articles about this incident or hazard