TikTok's AI Algorithm Amplifies Drug-Related Content to Minors

The TikTok platform uses AI algorithms to recommend content to users, including minors. The article explains that these algorithms promote drug-related content under hashtags like #Pingtok, exposing young users to drug use and informal drug markets. This exposure has led to increased drug consumption risks among minors, which is a harm to health and communities. The AI system's content moderation struggles, due to users' use of coded language, further exacerbate the problem. Since the AI system's use and malfunction (inadequate content moderation) have indirectly led to harm (increased drug use risk and related health harms among minors), this qualifies as an AI Incident under the OECD framework.

TikTok's recommendation algorithm is an AI system that influences the content users see. The article shows that this AI system indirectly leads to harm by promoting drug-related content to minors, increasing their exposure and risk of drug consumption and addiction, which is a harm to health and communities. The facilitation of drug trafficking through the platform further exacerbates this harm. Although TikTok attempts to moderate such content, the AI system's role in content recommendation and the use of 'algospeak' to evade moderation demonstrate a malfunction or misuse of the AI system. Hence, the event meets the criteria for an AI Incident due to indirect harm caused by the AI system's use.

TikTok's AI-powered recommendation algorithm is central to the phenomenon described, as it amplifies exposure to drug-related content among minors, which is a direct factor in the harm described (drug addiction risks, exposure to drug markets). The article documents actual harm occurring (drug use among minors, increased risk of overdose deaths), and the AI system's role is pivotal in enabling this exposure and facilitating drug sales through coded communication. This meets the criteria for an AI Incident because the AI system's use has directly or indirectly led to harm to communities and individuals. The article does not merely warn of potential harm (which would be an AI Hazard) nor is it focused on responses or updates (Complementary Information). It is not unrelated because the AI system (TikTok's algorithm) is clearly involved.

TikTok's AI-driven content recommendation system is explicitly involved, as it promotes and amplifies drug-related content to minors. The article details realized harm, including increased drug addiction risks and drug-related deaths among young people, linked to exposure on the platform. The AI system's use (content recommendation and moderation evasion) indirectly leads to these harms. The presence of coded language to evade moderation shows the AI system's limitations in preventing harm. Hence, this is an AI Incident involving indirect harm to health and communities caused by the AI system's use and malfunction (inadequate moderation).

TikTok's content recommendation algorithm is an AI system that influences what users see. The article explains that the algorithm continues to show drug-related videos under certain hashtags, even as TikTok attempts to moderate such content. Users adapt their language to evade detection, and the AI system inadvertently promotes this harmful content, leading to increased exposure and potential drug use among minors. This constitutes indirect harm to health and communities, fulfilling the criteria for an AI Incident. The article reports ongoing harm rather than just potential risk, so it is not merely a hazard or complementary information.