Child sexual abuse content growing online with AI-made images, report says
2024-04-16
Yahoo! Finance
The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
The National Center for Missing & Exploited Children reports a sharp rise in online child sexual abuse, with over 36 million cases in 2023. Generative AI is increasingly used to create illegal child sexual abuse images and videos, leading to exploitation, extortion, and significant harm to children and families.[AI generated]
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of generative AI to create child sexual abuse content, which is a direct violation of laws and causes severe harm to children and their families. The AI system's use in generating deepfake images and videos of child sexual exploitation constitutes a direct link between AI use and significant harm (violation of rights and harm to communities). The reports of AI-made CSAM and the associated harms confirm that this is not merely a potential risk but an ongoing incident involving AI systems. Hence, the classification as an AI Incident is appropriate.[AI generated]