AI-Generated Porn Harms Creators and Violates Rights

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

AI systems, including text-to-image generators and deepfake models, are being used to create synthetic pornographic content and impersonate real performers without consent. This has led to intellectual property violations, economic harm to sex workers, and deception of consumers, as AI-generated content circumvents verification and undermines creators' rights and livelihoods.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly involves AI systems (text-to-image generators, deepfake AI) used to create pornographic content and AI-generated personas for monetization. The use of deepfakes with real performers' videos without consent constitutes a violation of intellectual property and personal rights. The AI-generated content deceives users and undermines real creators' rights and income, causing harm to communities and individuals. This fits the definition of an AI Incident due to realized harm (violation of rights and harm to communities) directly linked to AI system use.[AI generated]
AI principles
Privacy & data governanceRespect of human rightsTransparency & explainabilitySafetyAccountabilityHuman wellbeingRobustness & digital security

Industries
Media, social platforms, and marketingConsumer services

Affected stakeholders
WorkersConsumers

Harm types
Economic/PropertyReputationalHuman or fundamental rightsPsychological

Severity
AI incident

AI system task:
Content generation


Articles about this incident or hazard

Thumbnail Image

Η τεχνητή νοημοσύνη "εισχώρησε" στη βιομηχανία του πορνό | in.gr

2023-10-22
in.gr
Why's our monitor labelling this an incident or hazard?
The article explicitly involves AI systems (text-to-image generators, deepfake AI) used to create pornographic content and AI-generated personas for monetization. The use of deepfakes with real performers' videos without consent constitutes a violation of intellectual property and personal rights. The AI-generated content deceives users and undermines real creators' rights and income, causing harm to communities and individuals. This fits the definition of an AI Incident due to realized harm (violation of rights and harm to communities) directly linked to AI system use.
Thumbnail Image

Η τεχνητή νοημοσύνη

2023-10-22
to10.gr
Why's our monitor labelling this an incident or hazard?
The event involves AI systems (text-to-image and deepfake generation models) used to create synthetic adult content and deepfake videos. The use and misuse of these AI systems have directly led to harms: violation of intellectual property rights (unauthorized use of real creators' videos), harm to adult content creators' livelihoods, and deception of platform users. These harms fit the definition of an AI Incident, as the AI system's use has directly led to violations of rights and harm to communities. Therefore, this event qualifies as an AI Incident.
Thumbnail Image

Τεχνητή νοημοσύνη: Πώς "διέλυσε" τη βιομηχανία του πορνό

2023-10-25
ΕΛΕΥΘΕΡΟΣ ΤΥΠΟΣ
Why's our monitor labelling this an incident or hazard?
The article explicitly involves AI systems (generative AI models like DALL-E 2, Stable Diffusion, and others) used to create adult content, including deepfakes. The AI's use has directly led to harms: unauthorized use of performers' content (intellectual property violation), economic harm to sex workers, and deception of consumers. The AI system's development and use are central to these harms. Hence, it meets the criteria for an AI Incident rather than a hazard or complementary information.
Thumbnail Image

Η τεχνητή νοημοσύνη "εισχώρησε" στη βιομηχανία του πορνό - Αγώνας της Κρήτης

2023-10-23
Αγώνας της Κρήτης
Why's our monitor labelling this an incident or hazard?
The event involves AI systems (text-to-image and deepfake generation models) used to create synthetic pornographic content that infringes on intellectual property rights and harms individuals by impersonation and unauthorized use of their images and videos. The AI-generated content is actively used and monetized, causing realized harm. The circumvention of verification systems and content filters further exacerbates the issue. Hence, this qualifies as an AI Incident due to violations of intellectual property rights and harm to communities through deceptive and unauthorized AI-generated content.
Thumbnail Image

Η τεχνητή νοημοσύνη "εισχώρησε" στη βιομηχανία του πορνό - Life Style - Athletic Σπορ FM 104,2

2023-10-23
Athletic Radio 104,2
Why's our monitor labelling this an incident or hazard?
The article explicitly involves AI systems (text-to-image generators, deepfake AI) used to create pornographic content and AI-generated models. The use of these AI systems has led to realized harms: intellectual property violations (unauthorized use of real creators' videos), harm to sex workers' rights and livelihoods, and deception of consumers. These harms fall under violations of rights and harm to communities. The AI systems' development and use are central to these harms, meeting the criteria for an AI Incident rather than a hazard or complementary information.