
The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
San Francisco officials have ordered Apple and Google to remove AI-powered 'nudify' apps from their app stores, citing the creation of non-consensual intimate deepfake images that exploit women and minors. The legal action highlights the direct harm caused by these AI systems and the platforms' alleged failure to prevent abuse.[AI generated]
Why's our monitor labelling this an incident or hazard?
The AI systems in the 'nudification' apps are explicitly used to create harmful deepfake content without consent, which constitutes a violation of human rights and leads to significant harm to individuals and communities. The presence and use of these AI systems have directly caused these harms, fulfilling the criteria for an AI Incident. The legal complaints and regulatory scrutiny further confirm the materialization of harm rather than just potential risk.[AI generated]