紐約州控TikTok讓數千兒少測安全功能 提供無效安慰劑工具
2026-10-08
Yahoo News (Taiwan)
The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
New York State sued TikTok, alleging it secretly tested non-functional safety features on thousands of users, including children and teens. The AI-driven recommendation system failed to protect users from harmful content, misleading them about their safety. At least one teenager reportedly died after exposure to self-harm content during these tests.[AI generated]
Why's our monitor labelling this an incident or hazard?
TikTok's recommendation system is an AI system that uses algorithms to curate content feeds. The 'algorithm refresh' safety feature is an AI-driven tool designed to modify these recommendations to protect users from harmful content. The lawsuit alleges that TikTok deliberately provided a placebo version of this feature to thousands of users, including minors, misleading them into believing they were protected when they were not. This misuse and malfunction of the AI system directly led to harm by exposing vulnerable users to potentially harmful content and violating their rights to safety and truthful information. The involvement of AI in content recommendation and the direct harm caused by the malfunction or intentional disabling of the safety feature meets the criteria for an AI Incident.[AI generated]