AI-Generated Fake Rabbis Spread Antisemitism on TikTok

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A coordinated network of at least 49 TikTok accounts used generative AI to create fake rabbis who spread antisemitic stereotypes and conspiracy theories. These AI-generated avatars amassed over 950,000 followers and 10 million likes, amplifying hate and misinformation by impersonating credible Jewish voices and deceiving audiences.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event explicitly describes AI-generated fake accounts used to spread antisemitic content, which is a clear violation of human rights and causes harm to communities. The AI system's role in generating and disseminating this content is pivotal to the harm occurring. Therefore, this qualifies as an AI Incident under the framework, as the AI system's use has directly led to harm.[AI generated]
AI principles
Respect of human rightsFairness

Industries
Media, social platforms, and marketing

Affected stakeholders
General publicOther

Harm types
PsychologicalHuman or fundamental rightsPublic interest

AI system task:
Content generation


Articles about this incident or hazard