Delhi High Court warns deepfake AI a serious menace

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

The Delhi High Court, hearing petitions for deepfake regulation, warned that unregulated AI-powered video, audio and image manipulation could become a serious societal threat—enabling misinformation, fraud and rights violations. Justices urged the Centre to develop counter-AI measures including detection, prevention, grievance support and public awareness.[AI generated]

Why's our monitor labelling this an incident or hazard?

Deepfake technology is an AI system that can generate realistic but fake audio-visual content. The article centers on the court's acknowledgment of the serious menace deepfakes could pose and the need for government action to regulate and mitigate these risks. No specific incident of harm has occurred yet, but the potential for harm (e.g., misinformation, reputational damage, social disruption) is clearly recognized. This fits the definition of an AI Hazard, where the AI system's use could plausibly lead to harm, but no direct or indirect harm has yet materialized. The article does not describe a realized AI Incident or complementary information about responses to a past incident, so AI Hazard is the appropriate classification.[AI generated]
AI principles
AccountabilityPrivacy & data governanceRespect of human rightsRobustness & digital securitySafetyTransparency & explainabilityDemocracy & human autonomyHuman wellbeing

Industries
Media, social platforms, and marketingDigital securityGovernment, security, and defenceFinancial and insurance services

Affected stakeholders
General public

Harm types
Public interestEconomic/PropertyReputationalHuman or fundamental rightsPsychological

AI system task:
Content generation


Articles about this incident or hazard