X's AI Algorithms Amplify and Monetize Hate Speech Amid Israel-Gaza Conflict

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A study by the Center for Countering Digital Hate found that X's AI-driven recommendation and monetization systems have amplified and financially rewarded hate speech targeting Jews and Muslims since the Israel-Gaza war began. Ten accounts posting such content grew rapidly in followers and profits, highlighting AI's role in spreading and incentivizing harmful content.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event explicitly involves AI systems in the form of X's algorithmic content moderation, recommendation, and ranking systems that amplify hateful content and enable monetization. The harm is realized as hate speech targeting minority communities is being spread and rewarded, causing harm to communities and violating rights. The AI system's development and use directly contribute to this harm by promoting and financially incentivizing hateful content. Therefore, this qualifies as an AI Incident under the framework, as the AI system's use has directly led to harm to communities and violations of rights.[AI generated]
AI principles
AccountabilityFairnessHuman wellbeingRespect of human rightsSafetyTransparency & explainabilityDemocracy & human autonomy

Industries
Media, social platforms, and marketing

Affected stakeholders
Other

Harm types
Human or fundamental rightsPublic interestPsychological

Business function:
Marketing and advertisement

AI system task:
Organisation/recommendersGoal-driven organisation


Articles about this incident or hazard