Delhi Man Arrested for AI-Generated Image Blackmail Scheme

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Delhi Police arrested a 30-year-old man, Sourav, for using AI-based tools to create morphed obscene images of young women, obtained under the pretense of job offers. He used these manipulated images to blackmail and extort money from victims via social media, causing financial and psychological harm.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event explicitly mentions the use of AI-based tools to create morphed images for blackmail and extortion, causing direct harm to victims through threats and financial loss. This meets the criteria for an AI Incident as the AI system's use directly led to violations of human rights and harm to individuals. Therefore, the classification is AI Incident.[AI generated]
AI principles
Privacy & data governanceRespect of human rights
Industries
Media, social platforms, and marketing
Affected stakeholders
Women
Harm types
Economic/PropertyPsychological
Severity
AI incident
AI system task:
Content generation

Articles about this incident or hazard