TikTok's AI Algorithms Enable Spread of Antisemitic and Hateful Content Among Youth

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

The Bildungsstätte Anne Frank criticizes TikTok for enabling the rapid spread of antisemitic, racist, and conspiratorial content among young users through its AI-driven recommendation and moderation systems. AI-generated images and hate speech are widely disseminated, contributing to the radicalization and harm of vulnerable communities.[AI generated]

Why's our monitor labelling this an incident or hazard?

TikTok's AI-powered recommendation system is directly involved in distributing harmful content that radicalizes young users and spreads antisemitic misinformation. The use of AI-generated images further implicates AI in the creation and spread of harmful content. This has led to realized harm to communities and potentially violates rights, meeting the criteria for an AI Incident. The article reports on ongoing harm rather than a potential or future risk, so it is not an AI Hazard or Complementary Information.[AI generated]
AI principles
FairnessRespect of human rightsSafetyAccountabilityTransparency & explainabilityDemocracy & human autonomy

Industries
Media, social platforms, and marketing

Affected stakeholders
ChildrenOther

Harm types
Human or fundamental rightsPsychologicalPublic interest

Business function:
Marketing and advertisementMonitoring and quality control

AI system task:
Organisation/recommendersEvent/anomaly detection


Articles about this incident or hazard