Instagram's AI Algorithms Linked to Teen Eating Disorders

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Instagram's AI-driven recommendation algorithms promoted harmful content related to body image and eating disorders, leading to severe health consequences for teen girls, including hospitalization and near death. The platform's AI amplified toxic content, contributing directly to the development and worsening of eating disorders among vulnerable users.[AI generated]

Why's our monitor labelling this an incident or hazard?

Instagram's AI-powered recommendation algorithms have directly contributed to harm by promoting harmful content related to eating disorders, as evidenced by the personal stories of teens who developed anorexia and other eating disorders after exposure to such content. The article cites internal Facebook research acknowledging the platform's negative impact on teen girls' mental health and body image. This constitutes direct harm to health (a) caused by the use of an AI system (Instagram's content recommendation AI). Therefore, this event qualifies as an AI Incident.[AI generated]
AI principles
SafetyHuman wellbeingAccountabilityTransparency & explainability

Industries
Media, social platforms, and marketing

Affected stakeholders
Children

Harm types
Physical (injury)Psychological

Business function:
Other

AI system task:
Organisation/recommenders


Articles about this incident or hazard