YouTube's AI Algorithm Promotes Banned Andrew Tate Content to Teen Users

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

An investigation found YouTube's AI recommendation algorithm repeatedly pushed nearly 30 Andrew Tate videos to a new 13-year-old user's feed within two hours, despite Tate being banned for misogynistic content. The algorithm's failure exposed minors to harmful material, raising concerns about platform safety and content moderation.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves AI systems explicitly through YouTube's recommendation algorithms that promoted banned content. The harm includes exposure of minors to harmful, misogynistic content and the platform's failure to enforce bans effectively, which indirectly leads to harm to communities and potentially violates rights. The AI system's use and malfunction (failure to filter or restrict content) directly contributed to the harm. Therefore, this qualifies as an AI Incident due to the realized harm caused by the AI system's outputs and platform policies.[AI generated]
AI principles
AccountabilitySafetyTransparency & explainabilityRespect of human rightsRobustness & digital securityHuman wellbeing

Industries
Media, social platforms, and marketing

Affected stakeholders
ChildrenWomen

Harm types
PsychologicalPublic interestReputationalHuman or fundamental rights

Business function:
Marketing and advertisementMonitoring and quality control

AI system task:
Organisation/recommenders


Articles about this incident or hazard