AI-Generated Explicit and Communally Sensitive Content Leads to Arrest in Hyderabad

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A 33-year-old man in Hyderabad was arrested for using AI tools to create and circulate sexually explicit and communally sensitive images on social media. The AI-generated content, shared via fake accounts, targeted specific communities, incited hatred, and threatened public order, prompting police intervention and legal action.[AI generated]

Why's our monitor labelling this an incident or hazard?

An AI system was used to create harmful content that has been posted on social media, leading to communal tensions and potential public disorder. The use of AI-generated content to incite hatred and disrupt social harmony constitutes a violation of rights and harm to communities. Since the harm is occurring or has occurred due to the AI system's use, this qualifies as an AI Incident.[AI generated]
AI principles
AccountabilityFairnessHuman wellbeingRespect of human rightsSafetyDemocracy & human autonomy

Industries
Media, social platforms, and marketing

Affected stakeholders
General public

Harm types
Public interestHuman or fundamental rights

AI system task:
Content generation


Articles about this incident or hazard