Delhi High Court Orders Removal of AI-Generated Obscene Content Targeting Janhvi Kapoor

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

The Delhi High Court ordered the removal of over 5,000 webpages containing AI-generated pornographic and impersonating content targeting actress Janhvi Kapoor. The court recognized the harm caused by unauthorized AI use to exploit her likeness and personality rights, while declining to ban fan pages or grant overly broad takedown requests.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly mentions the use of AI and deepfake technology to create abusive and pornographic content misusing Janhvi Kapoor's likeness, which directly harms her personality rights and reputation. This misuse of AI-generated content has led to realized harm, including violation of rights and commercial exploitation. The court's involvement to address these harms confirms the incident's significance. Hence, the event meets the criteria for an AI Incident as the AI system's use has directly led to violations of rights and reputational harm.[AI generated]
AI principles
Respect of human rightsPrivacy & data governance

Industries
Media, social platforms, and marketing

Affected stakeholders
Women

Harm types
ReputationalHuman or fundamental rights

AI system task:
Content generation


Articles about this incident or hazard