New York Authorities Shut Down 12 AI Deepfake Pornography Sites Targeting Celebrities

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

New York authorities seized and shut down 12 websites distributing AI-generated deepfake pornographic content featuring about 1,200 victims, including celebrities and politicians, without their consent. The operation, led by Manhattan District Attorney Alvin Bragg, highlights significant harm caused by AI misuse in violating privacy and rights.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly states that AI was used to generate hyperrealistic deepfake pornographic images and videos without consent, which constitutes a violation of rights and is illegal. The harm is realized and ongoing, affecting many victims. The AI system's use in creating and distributing this content directly led to the harm, qualifying this as an AI Incident under the framework's criteria for violations of human rights and harm to communities.[AI generated]
AI principles
Privacy & data governanceRespect of human rights

Industries
Media, social platforms, and marketing

Affected stakeholders
General public

Harm types
Human or fundamental rightsReputationalPsychological

AI system task:
Content generation


Articles about this incident or hazard