TikTok Algorithm Promotes Banned Far-Right Content in the US

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A Media Matters for America investigation found that TikTok's AI-driven recommendation algorithm promotes and facilitates the spread of banned far-right extremist content, including groups linked to the January 6 Capitol insurrection. Despite platform policies prohibiting such content, users are easily exposed to and encouraged to follow these accounts.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves an AI system—the TikTok recommendation algorithm—that is actively promoting extremist content, which can be linked to harm to communities by spreading extremist ideologies and potentially inciting violence or social disruption. The algorithm's role in recommending and amplifying such content directly contributes to this harm. Therefore, this qualifies as an AI Incident due to the realized harm caused by the AI system's outputs fostering exposure to extremist content.[AI generated]
AI principles
AccountabilityFairnessTransparency & explainabilitySafetyDemocracy & human autonomy

Industries
Media, social platforms, and marketing

Affected stakeholders
General publicCivil societyGovernment

Harm types
Public interest

Business function:
Marketing and advertisement

AI system task:
Organisation/recommenders


Articles about this incident or hazard