The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
AI Forensics found that Hugging Face hosts image-editing AI models that easily generate non-consensual sexualized deepfake images, including those of women and children, with minimal safeguards. The platform's lack of moderation enables widespread digital abuse and privacy violations, prompting regulatory scrutiny in the EU and UK.[AI generated]
Why's our monitor labelling this an incident or hazard?
The article explicitly states that seven out of nine AI image editing tools on Hugging Face generated fake nude images without needing to bypass security, directly causing harm by producing sexualized content without consent, including images of minors. This constitutes violations of human rights and harm to communities. The AI systems' outputs are central to the harm, fulfilling the criteria for an AI Incident. The platform's policies and partial enforcement do not prevent the harm, confirming the incident status rather than a hazard or complementary information.[AI generated]