Meta's AI Algorithms Linked to Harmful Content and User Safety Failures

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Whistleblower Frances Haugen revealed that Meta's AI-driven algorithms have amplified hate speech, misinformation, and harmful content, causing psychological harm to teens and inciting violence in vulnerable regions. Additionally, inadequate AI moderation in Meta's metaverse led to user harassment, highlighting systemic failures in safeguarding user well-being.[AI generated]

Why's our monitor labelling this an incident or hazard?

Facebook's content recommendation algorithms are AI systems that have been shown to cause real harm, including mental health damage and incitement of violence, as revealed by the whistleblower. The harm is direct and significant, involving health and community harm. The event is not merely a warning or potential risk but documents actual harm caused by AI system use and neglect. Hence, it meets the criteria for an AI Incident.[AI generated]
AI principles
SafetyHuman wellbeingAccountabilityTransparency & explainabilityRespect of human rightsFairnessRobustness & digital securityDemocracy & human autonomy

Industries
Media, social platforms, and marketingDigital security

Affected stakeholders
ChildrenGeneral public

Harm types
PsychologicalPhysical (injury)Human or fundamental rightsPublic interest

Business function:
Monitoring and quality controlMarketing and advertisement

AI system task:
Organisation/recommendersRecognition/object detection


Articles about this incident or hazard