TikTok's AI Algorithm Promotes Banned Content to Russian Users

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

TikTok's AI-driven recommendation system has been 'shadow promoting' banned and new Russian content, including state media propaganda, to users in Russia despite official restrictions. This algorithmic loophole undermines content moderation policies and enables the spread of disallowed and potentially harmful information.[AI generated]

Why's our monitor labelling this an incident or hazard?

TikTok's content recommendation algorithm is an AI system that influences what users see. The 'shadow promotion' of banned content means the AI system is indirectly causing harm by allowing restricted or potentially harmful content to be visible to users, which can lead to misinformation and violation of content moderation policies. This constitutes a violation of platform rules and potentially harms communities by spreading disallowed content. Since the AI system's use directly leads to this harm, this qualifies as an AI Incident.[AI generated]
AI principles
AccountabilityTransparency & explainabilityRobustness & digital securitySafetyRespect of human rightsDemocracy & human autonomy

Industries
Media, social platforms, and marketingGovernment, security, and defence

Affected stakeholders
General public

Harm types
Public interestHuman or fundamental rights

Business function:
Marketing and advertisementMonitoring and quality control

AI system task:
Organisation/recommenders


Articles about this incident or hazard