AI-Generated TikTok Videos Spread Sexist and Racist Stereotypes

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

On TikTok, AI-generated animated videos featuring fruit and vegetable characters have gone viral, spreading openly sexist and racist stereotypes. These short clips, created and monetized by content creators, have reached millions, raising concerns about the harmful impact and normalization of discriminatory narratives through AI-driven content.[AI generated]

Why's our monitor labelling this an incident or hazard?

The videos are explicitly generated by AI systems and are spreading sexist, racist, and violent stereotypes that harm communities and violate rights. The AI system's use in generating and disseminating this harmful content on a popular platform directly leads to social harm. The article describes realized harm through the propagation of discriminatory and hateful narratives, not just potential harm. Hence, it meets the criteria for an AI Incident rather than a hazard or complementary information.[AI generated]
AI principles
FairnessRespect of human rights

Industries
Media, social platforms, and marketing

Affected stakeholders
WomenGeneral public

Harm types
Human or fundamental rightsPsychological

Business function:
Other

AI system task:
Content generation


Articles about this incident or hazard