The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
Australia's eSafety Commissioner reports that major tech platforms, including Apple, Meta, Google, and others, are failing to adequately use available AI detection tools to combat child sexual abuse and sextortion. This insufficient use has led to ongoing harm, especially among young men and minors, despite clear guidance and regulatory pressure.[AI generated]
Why's our monitor labelling this an incident or hazard?
The article explicitly discusses the use and underuse of AI-related technologies (e.g., language analysis, detection tools) by major tech platforms to identify and prevent child sexual abuse and sexual extortion online. The harms described—sexual extortion and exploitation of minors—are direct harms to persons. The failure to deploy available AI systems effectively has contributed to these harms. This fits the definition of an AI Incident, where the use or malfunction (here, underuse or inadequate deployment) of AI systems has directly led to harm to people. The event is not merely a potential risk (hazard) or a response/update (complementary information), but a documented ongoing harm linked to AI system deployment gaps.[AI generated]