TikTok's AI Moderation Removes Millions of Videos, Faces Challenges with Harmful Content

The event describes TikTok's use of automated detection technology (likely AI systems) to identify and remove videos spreading false COVID-19 information. The removal of misinformation directly relates to harm prevention in public health and community well-being. Since the AI system's use is central to the detection and removal process, and the misinformation being removed constitutes a harm (harm to communities and public health), this qualifies as an AI Incident. The event reports realized harm (misinformation spreading) and the AI system's role in mitigating it, not just potential harm or general AI news.

The article explicitly mentions TikTok's use of algorithms (AI systems) to moderate and recommend content, which fails to adequately filter out inappropriate and harmful content for minors. This failure has led to minors accessing pornographic content and suffering sexual harassment, constituting harm to health and violation of rights. The AI system's malfunction or inadequate design in content moderation is a contributing factor to these harms. Hence, this qualifies as an AI Incident due to realized harm caused by the AI system's use.

The automated content moderation system is an AI system as it performs sophisticated content analysis and decision-making to remove videos violating community rules. The system's use directly leads to the removal of harmful content, which prevents harm to users and communities, aligning with harm to communities under the AI Incident definition. Although some false positives occur, the system's role is pivotal in managing harmful content. Therefore, this event qualifies as an AI Incident because the AI system's use directly leads to harm prevention and management of harmful content, which is a significant articulated harm to communities.