The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
A 17-year-old girl in Germany died after participating in a dangerous 'Deo-Challenge' promoted on TikTok. The platform's AI-driven recommendation system amplified such harmful content, exposing young users to life-threatening challenges. The incident highlights the risks posed by AI-curated social media content to youth safety.[AI generated]
Why's our monitor labelling this an incident or hazard?
TikTok is an AI system that uses algorithms to recommend and promote content, including challenges. The harmful 'Deo-Challenge' and other dangerous challenges are spread and amplified by TikTok's AI-driven recommendation system, which has directly or indirectly led to injury and death (Alexander's daughter). The article reports realized harm caused by the AI system's use, fulfilling the criteria for an AI Incident. The involvement is through use of the AI system, and the harm is injury and death to a person, which is a primary harm category. Hence, this is an AI Incident.[AI generated]