AI-Generated Deepfake Video Causes Distress and Privacy Concerns for Pakistani TikToker Jannat Mirza

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

An AI-generated deepfake video featuring TikToker Jannat Mirza without her consent went viral, causing her emotional distress and raising concerns about women's digital privacy and dignity. Politician Hina Parvez Butt demanded action against the misuse of AI for creating unauthorized content, highlighting broader risks for women in Pakistan.[AI generated]

Why's our monitor labelling this an incident or hazard?

An AI system was used to create a fake video of a person without consent, which is a direct misuse of AI technology causing harm to the individual's dignity and potentially to other women by setting a harmful precedent. The harm is realized as the video is viral and the person affected has publicly expressed distress. This fits the definition of an AI Incident because the AI system's use has directly led to harm to communities and violation of rights.[AI generated]
AI principles
Privacy & data governanceRespect of human rights

Industries
Media, social platforms, and marketing

Affected stakeholders
Women

Harm types
PsychologicalHuman or fundamental rights

AI system task:
Content generation


Articles about this incident or hazard