Meta Deletes 10 Million AI-Generated Facebook Accounts in Crackdown on Spam

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Meta has deleted around 10 million Facebook accounts in early 2025, targeting AI-generated and impersonator accounts that spread spam and degrade user experience. The company used AI-based detection to identify and remove these accounts, aiming to improve authenticity and reward original content creators.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves the use of AI technology both in the generation of spammy content and in Meta's detection and suppression of duplicate or AI-assisted low-quality content. The deletion of accounts is a direct response to AI-generated harmful content flooding the platform, which harms the community by spreading misinformation and degrading user experience. Since the AI system's use has directly led to harm to communities through spam and impersonation, and Meta's AI-based countermeasures are part of the response, this qualifies as an AI Incident.[AI generated]
AI principles
Transparency & explainabilityAccountabilityFairnessPrivacy & data governanceRobustness & digital securitySafetyRespect of human rightsHuman wellbeing

Industries
Media, social platforms, and marketingDigital securityIT infrastructure and hosting

Harm types
Economic/PropertyReputationalPsychologicalHuman or fundamental rights

Business function:
Monitoring and quality controlICT management and information security

AI system task:
Event/anomaly detection


Articles about this incident or hazard