Deepfake Sites Exploit Sign-in with Apple for Non-consensual Images

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Deepfake websites have exploited Apple's Sign-in feature to create non-consensual nude images, raising privacy concerns. Apple and Discord have blocked developers from using their sign-in APIs after reports revealed their misuse. These AI-generated deepfakes pose significant ethical and legal challenges, as they violate human rights and privacy laws.[AI generated]

Why's our monitor labelling this an incident or hazard?

The websites use AI models to remove clothing from real photos without consent, producing harmful deepfakes that are used to bully, humiliate, and threaten victims. This constitutes a direct harm—violation of personal and human rights—stemming from the use of AI systems. The article documents ongoing abuse, signifying an AI Incident rather than a future risk or mere update.[AI generated]
AI principles
Privacy & data governanceRespect of human rightsSafetyRobustness & digital securityAccountabilityHuman wellbeingTransparency & explainability

Industries
Media, social platforms, and marketingDigital securityIT infrastructure and hostingConsumer services

Affected stakeholders
General public

Harm types
Human or fundamental rightsPsychologicalReputational

Business function:
Other

AI system task:
Content generationRecognition/object detection


Articles about this incident or hazard