Indian Powerlifter Targeted by AI-Generated Deepfake Harassment

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Indian powerlifter Keyaa Kunal Banerji became the victim of mass online harassment after AI was used to generate thousands of non-consensual, explicit images of her. The AI-generated deepfakes led to sexual harassment, fake accounts, and significant emotional distress, highlighting the misuse of AI for personal harm and gender-based discrimination.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article describes how AI was used to generate inappropriate and non-consensual images of the athlete, which caused her significant harm including online harassment and account suspension due to malicious reporting. The AI system's role in creating these images is pivotal to the harm experienced. This constitutes a violation of rights and harm to the individual and community, fitting the definition of an AI Incident. The harm is realized, not just potential, and the AI system's misuse is central to the event.[AI generated]
AI principles
FairnessRespect of human rights

Industries
Media, social platforms, and marketingDigital security

Affected stakeholders
Women

Harm types
PsychologicalReputationalHuman or fundamental rights

AI system task:
Content generation


Articles about this incident or hazard