AI-Generated Violent Fruit and Vegetable Videos on TikTok Linked to Youth Radicalization

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Researchers warn that AI-generated videos depicting anthropomorphic fruits and vegetables committing graphic violence are spreading extremist ideologies on TikTok. These clips, often styled innocuously, bypass moderation and risk radicalizing children by normalizing violence and promoting extremist propaganda, including content linked to groups like Islamic State.[AI generated]

Why's our monitor labelling this an incident or hazard?

The AI system's use in generating violent and extremist content directly leads to harm by spreading extremist agendas and normalizing violence among young users, which is a violation of rights and harms communities. The content is actively being disseminated and consumed, causing realized harm rather than just a potential risk. Therefore, this event qualifies as an AI Incident due to the direct link between AI-generated content and harm to communities through radicalization and exposure to violent extremist material.[AI generated]
AI principles
SafetyDemocracy & human autonomy

Industries
Media, social platforms, and marketing

Affected stakeholders
Children

Harm types
PsychologicalPublic interest

AI system task:
Content generation


Articles about this incident or hazard