TikTok Algorithm Amplifies Misogynistic Content Among Teens, Study Finds

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A joint study by University College London and the University of Kent found that TikTok's AI-driven recommendation algorithm rapidly amplifies misogynistic content, leading to a fourfold increase in such material in just five days. This normalization of harmful ideologies is impacting young people's attitudes and mental health, especially among vulnerable boys.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly mentions AI-powered algorithms as a key factor in pushing misogynistic content to boys online, which then influences their offline behavior, increasing sexist language and harmful attitudes in schools. This constitutes indirect harm caused by the use of AI systems (social media recommendation algorithms) that amplify harmful content. The harm is realized and ongoing, affecting young people and school communities. Therefore, this qualifies as an AI Incident due to the direct link between AI system use and harm to communities through the spread of misogynistic content.[AI generated]
AI principles
AccountabilityFairnessHuman wellbeingRespect of human rightsSafetyTransparency & explainabilityDemocracy & human autonomyRobustness & digital security

Industries
Media, social platforms, and marketing

Affected stakeholders
ConsumersChildren

Harm types
PsychologicalPublic interestHuman or fundamental rights

Business function:
Marketing and advertisement

AI system task:
Organisation/recommenders


Articles about this incident or hazard