Meta ran ads for an app that only needs one photo and no consent
2026-08-19
TheStreet
The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
Meta approved and ran ads for Kromix, an AI app that generates nonconsensual nude deepfakes of real women, including prominent U.S. politicians. The app was also available on Apple's App Store. Both companies' review systems failed to block the harmful content until media inquiries prompted removal.[AI generated]
Why's our monitor labelling this an incident or hazard?
The event describes the use of AI-powered apps to create and distribute non-consensual deepfake pornography, which is a clear violation of human rights and privacy. The AI systems were used maliciously to generate harmful content, and the platforms' failure to prevent the ads and app availability led to direct harm. The involvement of AI in generating the content and the failure of AI-based detection and moderation systems to prevent the harm meets the criteria for an AI Incident. The harm is realized, not just potential, and involves violations of rights and harm to communities, fulfilling the definitions for an AI Incident.[AI generated]