West Virginia Sues Snap Inc. Over AI-Driven Child Exploitation and Sextortion Deaths

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

West Virginia's Attorney General sued Snap Inc., alleging Snapchat's AI features, including the 'My AI' chatbot and content algorithms, exposed minors to sexual exploitation and harmful content. The lawsuit cites suicides of local teens following sextortion schemes facilitated via Snapchat, accusing Snap of deceptive safety claims and inadequate AI safeguards.[AI generated]

Why's our monitor labelling this an incident or hazard?

Snapchat's platform likely uses AI-driven algorithms to recommend and filter content, which is central to the allegations of exposing children to harmful and exploitative content. The lawsuit links these harms directly to the platform's design and operation, implicating the AI systems in promoting compulsive use and enabling sextortion schemes. The suicides of minors are severe harms directly connected to the platform's AI-driven content delivery. Hence, this is an AI Incident due to the realized harm caused by the AI system's use.[AI generated]
AI principles
Respect of human rightsSafety

Industries
Media, social platforms, and marketing

Affected stakeholders
Children

Harm types
Physical (death)PsychologicalHuman or fundamental rights

Business function:
Marketing and advertisement

AI system task:
Interaction support/chatbotsOrganisation/recommenders


Articles about this incident or hazard