Meta's AI-Driven Account Purge Causes Mass Suspensions and Follower Losses

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Meta's recent deployment of advanced AI systems to enforce age restrictions and remove fake or inactive accounts on Instagram and Facebook led to widespread account suspensions, including for legitimate users and celebrities like Lee Yufen and Sunny Wang. The AI's misjudgments caused significant follower losses and user distress, especially in Taiwan.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly mentions the use of advanced AI systems by Meta to analyze user profiles and images to enforce age restrictions and remove fake or inactive accounts. The AI system's use has directly caused the removal of large numbers of followers and account suspensions, which constitutes harm to communities (disruption of social media communities and user reputations) and potential violations of user rights (account suspensions without clear due process). The harm is realized and ongoing, not merely potential. Hence, this is an AI Incident rather than a hazard or complementary information.[AI generated]
AI principles
FairnessAccountability
Industries
Media, social platforms, and marketing
Affected stakeholders
Consumers
Harm types
ReputationalPsychological
Business function:
Monitoring and quality control
AI system task:
Event/anomaly detection

Articles about this incident or hazard