AI-Generated Deepfake Pornography Harms Twitch Streamers and Influencers

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

AI-powered deepfake technology has been used to create and distribute nonconsensual pornographic videos featuring Twitch streamers and influencers, notably targeting women. Victims, including Sweet Anita, report emotional and reputational harm, while the proliferation of such content highlights the ongoing risks and lack of legal protection against AI-driven identity violations.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly involves AI systems used to generate deepfake videos, which have directly led to harm by violating women's rights and causing psychological and reputational damage. This constitutes a violation of human rights and harm to communities, fitting the definition of an AI Incident. The harm is realized and ongoing, not merely potential, and the AI system's role is pivotal in creating these nonconsensual deepfake videos. Therefore, the event qualifies as an AI Incident.[AI generated]
AI principles
AccountabilityFairnessHuman wellbeingPrivacy & data governanceRespect of human rightsRobustness & digital securitySafetyTransparency & explainability

Industries
Media, social platforms, and marketingDigital security

Affected stakeholders
Women

Harm types
PsychologicalReputationalHuman or fundamental rights

AI system task:
Content generation

In other databases


Articles about this incident or hazard