Mumbai Man Arrested for Using AI to Create and Share Non-Consensual Explicit Images of Women

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A 31-year-old man in Mumbai was arrested for secretly filming women on local trains, using AI applications to morph their images into nude or semi-nude photos, and uploading the manipulated content to Instagram. The incident came to light after a 19-year-old victim reported her morphed image online.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event describes the use of AI to create non-consensual nude and semi-nude images from secretly filmed photographs, which were then distributed on Instagram. This constitutes a violation of human rights, specifically privacy and dignity, and is a clear harm caused by the AI system's misuse. The involvement of AI in generating the harmful content and the resulting impact on victims meets the criteria for an AI Incident.[AI generated]
AI principles
Privacy & data governanceRespect of human rights

Industries
Media, social platforms, and marketing

Affected stakeholders
Women

Harm types
Human or fundamental rightsPsychologicalReputational

AI system task:
Content generation


Articles about this incident or hazard