Delhi Man Arrested for Creating and Circulating Obscene AI-Generated Images of Woman

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A 22-year-old B.Tech graduate in Delhi was arrested for using AI tools to create and circulate obscene, morphed images of a former college acquaintance. The victim's private photos were used to generate explicit content, which was distributed via fake social media accounts, resulting in harassment and threats.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event describes the use of AI systems to create obscene images of a woman, which were then circulated online to harass and humiliate her. This constitutes a violation of human rights and privacy, fulfilling the criteria for an AI Incident. The AI system's use directly led to harm (harassment, threats, violation of rights). Therefore, this is classified as an AI Incident.[AI generated]
AI principles
Respect of human rightsPrivacy & data governance

Industries
Media, social platforms, and marketing

Affected stakeholders
Women

Harm types
Human or fundamental rightsPsychologicalReputational

AI system task:
Content generation


Articles about this incident or hazard