The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
Thousands of child sexual abuse images were discovered in the LAION-5B dataset, used to train popular AI image generators like Stable Diffusion and Imagen. This led to the generation and potential dissemination of illegal and harmful content, prompting the dataset's withdrawal and raising concerns about AI's role in perpetuating abuse.[AI generated]
Why's our monitor labelling this an incident or hazard?
The event involves an AI system (image-generating models trained on the LAION 5B dataset) whose development and use have directly led to harm by including illegal and harmful content (CSAM) in training data. This inclusion facilitates the creation of harmful AI-generated images, constituting a violation of human rights and causing harm to communities. Therefore, this qualifies as an AI Incident. The article also discusses mitigation efforts, but the primary focus is on the realized harm and its direct link to the AI system's training data.[AI generated]
