AI-Generated Virtual Models Spark Debate and Ethical Concerns on OnlyFans

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

AI systems like MidJourney and Stable Diffusion are being used to create hyperrealistic virtual models for OnlyFans, raising concerns about potential consumer deception, economic impact on human creators, and ethical issues. While no direct harm has been reported, the trend has sparked debate over transparency and the future of adult content platforms.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article involves AI systems generating hyperrealistic images used commercially on adult content platforms. The AI's role is central to the event. However, the article does not report any realized harm such as fraud complaints, legal violations, or health impacts. Instead, it highlights a debate and potential for future harm due to possible user deception and lack of clear disclosure. Therefore, this situation fits the definition of an AI Hazard, as the AI-generated content could plausibly lead to harm (e.g., deception, consumer rights issues) if not regulated or disclosed properly. It is not Complementary Information because the main focus is not on responses or governance but on the emerging situation itself. It is not an AI Incident because no direct or indirect harm has been reported as having occurred yet.[AI generated]
AI principles
Transparency & explainabilityFairnessAccountabilityPrivacy & data governanceRespect of human rightsHuman wellbeing

Industries
Media, social platforms, and marketingArts, entertainment, and recreationConsumer services

Affected stakeholders
ConsumersWorkers

Harm types
Economic/PropertyReputationalHuman or fundamental rights

Severity
AI hazard

Business function:
Other

AI system task:
Content generation


Articles about this incident or hazard