Twitter's AI Algorithm Promotes Child Sexual Abuse Content Despite Moderation Claims

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Multiple reports reveal that Twitter's AI-driven recommendation algorithm has promoted child sexual abuse imagery (CSAM), leading to widespread viewing and sharing of illegal content. Despite Elon Musk's assurances and some content removals, significant CSAM persists and is amplified by the platform's AI systems, causing ongoing harm.[AI generated]

Why's our monitor labelling this an incident or hazard?

Twitter employs AI systems, including recommendation algorithms, to curate and suggest content. The article details how these AI-driven features have indirectly facilitated the spread of child sexual abuse material, causing significant harm to victims and communities. The failure to adequately detect and remove this content, partly due to reduced use of detection software and staff cuts, has allowed the harm to persist. This constitutes an AI Incident because the AI system's use and malfunction have directly and indirectly led to violations of human rights and harm to communities through the dissemination of illegal and harmful content.[AI generated]
AI principles
AccountabilitySafetyRespect of human rightsHuman wellbeingTransparency & explainability

Industries
Media, social platforms, and marketing

Affected stakeholders
Children

Harm types
PsychologicalHuman or fundamental rights

Severity
AI incident

AI system task:
Organisation/recommenders


Articles about this incident or hazard