TikTok and Instagram Ban Accounts for Unlabeled, Exploitative AI-Generated Black Female Avatars

The event clearly involves AI systems generating digital avatars and videos, which are used in harmful ways including sexual exploitation, racial stereotyping, and identity theft. The AI-generated content is misleading and not properly labeled, violating platform policies and causing harm to individuals and communities. TikTok's banning of accounts confirms the recognition of harm. The harms are realized, not just potential, including violation of rights and harm to communities. Hence, this is an AI Incident rather than a hazard or complementary information.

The event clearly involves AI systems generating manipulated videos and images, fulfilling the AI system involvement criterion. The use of these AI-generated avatars to impersonate real people and drive traffic to explicit content without consent constitutes a violation of intellectual property rights and potentially human rights, as well as harm to the affected individuals and communities. The harm is realized, not just potential, as the manipulated content is actively disseminated and has caused reputational and personal harm. Therefore, this qualifies as an AI Incident under the definitions provided, specifically under violations of human rights and intellectual property rights, and harm to communities.

The event explicitly involves AI systems generating fake avatars impersonating Black influencers in a harmful and exploitative way, which has led to violations of rights and harm to communities. The AI-generated content is used to mislead users and direct them to adult websites, causing social and ethical harm. The banning of accounts is a response to this realized harm. Hence, the AI system's use has directly led to harm, meeting the criteria for an AI Incident.

The event explicitly involves AI systems generating digital avatars and videos that have directly led to harms including exploitation, racial stereotyping, misleading users, and intellectual property theft. The misuse of AI-generated content to promote sexually explicit material without consent and the failure to label AI content as required are direct causes of harm. TikTok's banning of accounts confirms the recognition of harm. The harms fall under violations of rights and harm to communities, meeting the criteria for an AI Incident rather than a hazard or complementary information.

The event explicitly involves AI systems generating sexually explicit content without disclosure, which breaches platform guidelines and causes harm through racist and exploitative portrayals of black women. The non-consensual use of a content creator's videos further constitutes a violation of rights. The harms described include violations of human rights, harm to communities, and gendered violence facilitated by AI-generated deepfakes and manipulated images. These harms have materialized, not just potential, making this an AI Incident rather than a hazard or complementary information.

The event involves AI systems generating manipulated images and videos that have been used to promote harmful, sexualized, and racially discriminatory content, directly causing harm to individuals (violation of rights, exploitation, and reputational harm) and communities (perpetuation of racist stereotypes and sexual exploitation). The misuse of AI-generated content to deceive users and promote paid explicit content constitutes a violation of rights and harm to communities. The TikTok platform's removal of accounts confirms the harm was realized. Therefore, this qualifies as an AI Incident due to the direct and indirect harms caused by the AI-generated content and its misuse.

The event involves AI systems generating manipulated images and videos that perpetuate racist stereotypes and sexual exploitation, directly harming communities and violating rights. The unauthorized use of a real person's videos to create AI avatars further constitutes a violation of intellectual property and personal rights. The platforms' removal of accounts after the harm was exposed confirms the harm was realized. Hence, this is an AI Incident as the AI system's use directly led to harm to communities and breaches of rights.

The event involves AI systems generating realistic but artificial images and videos used in a harmful manner—sexualizing and stereotyping Black women and misleading users by not disclosing the AI origin. The AI-generated content directly contributed to the harm by perpetuating racial stereotypes and deceptive practices, which affect communities and violate rights. The removal of accounts confirms the harm was realized and addressed. Hence, this is an AI Incident due to direct harm caused by the AI system's use.

The event involves AI systems generating realistic images and videos that were used without consent and to promote sexual content, causing harm to individuals (violation of intellectual property and personal rights) and communities (misleading users, spreading sexualized AI content). The AI system's development and use directly led to these harms, fulfilling the criteria for an AI Incident. The removal of accounts and platform responses are reactions to the incident, not the main focus, so this is not merely Complementary Information.

The event involves AI systems generating manipulated images and videos that sexualize and misrepresent Black women, causing harm through racial stereotyping and unauthorized use of real individuals' content. The harm is realized, not just potential, as the manipulated content reached millions and caused ethical and social damage. TikTok's removal of accounts confirms the AI system's role in causing harm. Hence, this is an AI Incident due to direct harm to communities and violation of rights through AI misuse.