AI-Generated Videos Sexualizing Slavery in Brazil Spark Outrage and Harm

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Over 150 YouTube channels have used AI to create ultrarealistic videos that sexualize and romanticize slavery in Brazil, spreading racist and sexist stereotypes. These monetized videos, viewed millions of times in multiple languages, perpetuate misinformation and cause significant harm to communities and human rights.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves AI systems explicitly used to generate video content with ultrarealistic images and narratives that sexualize and romanticize slavery, spreading racist stereotypes and misinformation. This content causes harm to communities by perpetuating racial discrimination and offensive portrayals, which aligns with harm category (d) Harm to communities and (c) Violations of human rights. The AI's role is pivotal as it enables rapid, large-scale production and dissemination of such harmful content. The harm is realized, not just potential, as millions have viewed these videos and the content influences public perception negatively. Thus, the event meets the criteria for an AI Incident.[AI generated]
AI principles
FairnessRespect of human rights

Industries
Media, social platforms, and marketing

Affected stakeholders
General publicWomen

Harm types
PsychologicalHuman or fundamental rightsPublic interest

AI system task:
Content generation


Articles about this incident or hazard