TikTok's AI Algorithm Accused of Exposing Young Girls to Adult Content

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A joint investigation by UK and Australian groups found TikTok's AI-driven recommendation system promotes and normalizes adult content to young girls by surfacing coded lifestyle videos from OnlyFans creators. The AI system's moderation failures allow indirect exposure of minors to sexualized material, raising concerns about child protection and exploitation.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly discusses TikTok's algorithmic content recommendation system, which is an AI system, as central to the spread and normalization of sex industry promotion to young audiences. The harm includes indirect exposure of minors to sexualized content and grooming, which is a violation of protections for children and harm to communities. The AI system's use in recommending and amplifying such content is a contributing factor to this harm. The event involves the use of an AI system leading to realized harm, meeting the criteria for an AI Incident rather than a hazard or complementary information.[AI generated]
AI principles
SafetyRespect of human rights

Industries
Media, social platforms, and marketing

Affected stakeholders
Children

Harm types
PsychologicalHuman or fundamental rights

Business function:
Marketing and advertisement

AI system task:
Organisation/recommenders


Articles about this incident or hazard