TikTok Algorithm Amplifies Spread of Suicide Video

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

TikTok's AI-powered recommendation algorithm made it difficult to stop the rapid spread of a graphic suicide video, originally streamed on Facebook, across its platform. Despite efforts to remove the content and ban accounts re-uploading it, the algorithm's promotion exposed many users to harmful material, causing community distress.[AI generated]

Why's our monitor labelling this an incident or hazard?

TikTok's recommendation algorithm is an AI system that selects and promotes content based on user interactions and video metadata. The article states that this algorithm continues to show a video of a suicide, making it difficult to stop its spread. This exposure to harmful content can cause psychological harm to viewers, especially vulnerable groups like children and adolescents. The AI system's malfunction or limitations in filtering such content have directly led to this harm. Hence, the event meets the criteria for an AI Incident due to direct harm caused by the AI system's outputs.[AI generated]
AI principles
SafetyHuman wellbeingTransparency & explainabilityAccountabilityRespect of human rights

Industries
Media, social platforms, and marketing

Affected stakeholders
General public

Harm types
Psychological

Business function:
Marketing and advertisement

AI system task:
Organisation/recommenders

In other databases

Articles about this incident or hazard