GLAAD: Social Media AI Moderation Fails to Protect LGBTQ+ Users

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

GLAAD’s Social Media Safety Index gave failing grades to Facebook, Instagram, Threads, YouTube and X, citing flawed AI moderation and data protection failures that allow hate speech, misgendering, and disinformation targeting LGBTQ+ users. Only TikTok scored a D+ by improving pronoun options and transparency.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves AI systems because social media platforms rely heavily on AI for content moderation, policy enforcement, and recommendation algorithms. The harms described—failure to protect user data, inability to stop hate speech and disinformation—are direct harms to LGBTQ+ communities and users. Since these harms are ongoing and linked to the AI systems' use and malfunction in enforcing policies, this qualifies as an AI Incident under the framework, specifically harm to communities and violations of rights.[AI generated]
AI principles
AccountabilityFairnessPrivacy & data governanceRespect of human rightsRobustness & digital securitySafetyTransparency & explainability

Industries
Media, social platforms, and marketing

Affected stakeholders
Consumers

Harm types
PsychologicalHuman or fundamental rights

Severity
AI incident

Business function:
Monitoring and quality control

AI system task:
Other


Articles about this incident or hazard

Thumbnail Image

Major Social Media Sites Are Failing LGBTQ+ People: Report

2024-05-22
HuffPost
Why's our monitor labelling this an incident or hazard?
The event involves AI systems because social media platforms rely heavily on AI for content moderation, policy enforcement, and recommendation algorithms. The harms described—failure to protect user data, inability to stop hate speech and disinformation—are direct harms to LGBTQ+ communities and users. Since these harms are ongoing and linked to the AI systems' use and malfunction in enforcing policies, this qualifies as an AI Incident under the framework, specifically harm to communities and violations of rights.
Thumbnail Image

Major Social Media Sites Are Failing LGBTQ+ People: Report

2024-05-22
Yahoo
Why's our monitor labelling this an incident or hazard?
The article explicitly discusses the use of AI tools for content moderation and automated gender recognition, which are AI systems by definition. It details how these AI systems fail to adequately protect LGBTQ+ users, allowing harmful content and misinformation to spread, which has led to real-world harms such as harassment, threats, and violations of privacy and rights. The harms described fall under violations of human rights and harm to communities. Since the AI systems' malfunction or misuse is a contributing factor to these harms, this qualifies as an AI Incident rather than a mere hazard or complementary information.
Thumbnail Image

GLAAD gives failing grades to major social media platforms on LGBTQ safety: report

2024-05-21
The Hill
Why's our monitor labelling this an incident or hazard?
While the article mentions artificial intelligence and its role in social media safety, it does not describe a concrete event where AI systems caused harm or a plausible future harm scenario. The focus is on policy evaluation and platform performance in protecting LGBTQ users, which constitutes complementary information about AI's societal impact rather than an incident or hazard. Therefore, it fits the category of Complementary Information as it provides context and analysis without reporting a specific AI-related harm or risk event.