AI-Powered Child Safety Features on Social Media Platforms Fail to Protect Minors

The social media platforms employ AI systems for content recommendation, moderation, and user interaction controls, which are explicitly mentioned or reasonably inferred given the nature of the platforms and described features. The study found that these AI-driven safety features are broken, missing, or easily bypassed, leading to direct harms such as exposure of children to adult strangers, harmful content, and ineffective time limits. These harms constitute violations of children's rights and harm to their health and well-being. Since the AI systems' malfunction or ineffective deployment directly led to these harms, this event meets the criteria for an AI Incident. The article does not merely discuss potential risks or responses but documents realized harms caused by AI system failures.

The event involves AI systems explicitly in the form of automated safety features on social media platforms designed to protect children. The research demonstrates that these AI systems fail to function as intended, leading to direct harm or increased risk of harm to children, such as exposure to harmful content and unsafe interactions. The failure of these AI safety features to operate effectively is a malfunction or misuse of AI systems that has already caused or is causing harm, meeting the criteria for an AI Incident. The harms include violations of children's rights to safety and wellbeing, harm to communities (children and youth), and potential psychological injury. Therefore, this event is classified as an AI Incident rather than a hazard or complementary information.

The social media platforms employ AI systems for content recommendation, search suggestions, and user connection algorithms. The study found that these AI-driven safety features are broken, missing, or easily bypassed, resulting in direct harm to minors through exposure to harmful content and unsafe interactions. This meets the definition of an AI Incident because the AI systems' malfunction or ineffective use has directly led to harm to health and communities. The article documents realized harm rather than potential harm, so it is not an AI Hazard. It is not merely complementary information because the main focus is on the failure of AI safety features causing harm, not on responses or updates. Hence, the classification is AI Incident.

The child safety features on social media platforms are typically AI systems that monitor and filter content to protect children. The study shows that at least half of these features fail, implying malfunction or ineffective use of AI systems. This failure has led to harm or risk of harm to children, as indicated by lawsuits claiming harm caused by these platforms. The AI system's malfunction or ineffective performance is a contributing factor to the harm, meeting the criteria for an AI Incident.