The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
A bug in Discord's AI moderation system led to the wrongful banning of over 8,000 user accounts between May and July 2026. Harmless images, such as spreadsheets and chessboards, were falsely flagged as harmful content, bypassing human review. Discord has fixed the issue and is restoring affected accounts.[AI generated]
Why's our monitor labelling this an incident or hazard?
The AI system is explicitly involved as the automatic moderation AI of Discord. Its malfunction—confusing grid-like images with illegal content—has directly led to wrongful bans and account losses, which constitute harm to users and communities. The article details realized harm (bans, account loss, potential legal reporting) caused by the AI's erroneous outputs. This fits the definition of an AI Incident because the AI system's malfunction has directly led to violations of user rights and harm to communities. The event is not merely a potential risk or a complementary update but a concrete incident with actual harm.[AI generated]