AI-Generated Deepfake Video Causes Emotional Harm to KATSEYE's Lara Raj

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

An AI-generated deepfake video falsely depicting KATSEYE member Lara Raj using offensive and racist language circulated online, causing her emotional distress and reputational harm. The incident highlights the dangers of AI misuse in fabricating harmful content and its impact on individuals and communities.[AI generated]

Why's our monitor labelling this an incident or hazard?

The deepfake video was created using AI technology to fabricate harmful and false content about Lara Raj, which has caused emotional distress and reputational harm. This fits the definition of an AI Incident because the AI system's use directly led to harm to a person (emotional and reputational harm) and harm to the community through the spread of false and offensive content. The incident involves the use of AI-generated content that has materialized harm, not just a potential risk, so it is classified as an AI Incident.[AI generated]
AI principles
Respect of human rightsAccountability

Industries
Media, social platforms, and marketing

Affected stakeholders
Women

Harm types
PsychologicalReputational

AI system task:
Content generation


Articles about this incident or hazard