
The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
Tencent's QQ platform used AI-driven group recommendation algorithms that matched educational keyword searches with inappropriate groups, exposing minors to scams and harmful content. Following media reports and public concern, Tencent disabled these recommendation features and pledged to strengthen protections for minors online.[AI generated]
Why's our monitor labelling this an incident or hazard?
The event explicitly involves AI systems in the form of QQ's algorithmic group recommendation and search matching features that linked educational keywords to inappropriate and potentially harmful groups. This AI-driven recommendation system directly led to minors being exposed to scams and harmful content, causing economic harm and violating their rights. The harm is realized and significant, including financial losses and exposure to inappropriate content. Therefore, this qualifies as an AI Incident due to direct harm caused by the AI system's use and malfunction in content recommendation and user protection.[AI generated]