YouTube and X Drive Millions to AI Nudify Apps, Enabling Deepfake Abuse

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A report by the Institute for Strategic Dialogue reveals that mainstream platforms YouTube and X have directed over 5.7 million users to AI-powered 'nudify' apps between December 2025 and March 2026. These tools generate non-consensual explicit deepfake images, causing widespread digital harassment and violating individuals' rights despite platform policies against such content.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves AI systems explicitly described as generative AI tools used to create non-consensual explicit deepfake images, which directly cause harm to individuals' rights and dignity. The widespread dissemination and facilitation by major social media platforms amplify these harms. The harms include violations of human rights (privacy, consent), harm to communities, and reputational damage. The AI systems' development and use have directly led to these harms, meeting the definition of an AI Incident. The report's focus on realized harm and systemic issues confirms this classification rather than a mere hazard or complementary information.[AI generated]
AI principles
Respect of human rightsPrivacy & data governance

Industries
Consumer servicesMedia, social platforms, and marketing

Affected stakeholders
General public

Harm types
PsychologicalHuman or fundamental rightsReputational

Business function:
Other

AI system task:
Content generation


Articles about this incident or hazard