TikTok's AI Moderation Fails to Curb Antisemitic Content, Prompting High-Level Talks

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Israeli President Isaac Herzog met with TikTok executives to address a surge in antisemitic and anti-Israel content on the platform. Despite AI-driven moderation, harmful content, including hate speech and misinformation, remained online, highlighting failures in TikTok's AI systems and resulting in harm to affected communities.[AI generated]

Why's our monitor labelling this an incident or hazard?

TikTok uses AI systems for content recommendation and moderation. The presence of antisemitic and harmful content that was either removed only after a delay or not removed at all indicates a failure or inadequacy in the AI system's moderation capabilities, which has directly led to harm to communities by allowing hate speech and misinformation to persist. This fits the definition of an AI Incident as the AI system's use and malfunction (ineffective moderation) has directly led to harm to communities.[AI generated]
AI principles
FairnessRespect of human rightsAccountabilityRobustness & digital securitySafety

Industries
Media, social platforms, and marketing

Affected stakeholders
General public

Harm types
Human or fundamental rightsPsychological

Business function:
Other

AI system task:
Other


Articles about this incident or hazard