TikTok Algorithm Linked to Doubling of Child Eating Disorders

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

In England, children’s eating disorders have doubled over the past decade, with over 10,600 awaiting treatment. Research shows just ten minutes on TikTok’s AI-driven recommendation feed can distort body image and promote self-harm content. Experts warn the algorithmic boost of harmful content necessitates urgent government intervention for early prevention.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly links TikTok's recommendation algorithm, an AI system, to the dissemination of harmful pro-anorexia content that negatively affects young women's body image and increases the risk of eating disorders. The harm (health injury to children and young women) is realized and ongoing, with increased waiting times for treatment exacerbating the issue. The AI system's role is pivotal in promoting harmful content, which contributes indirectly to the rise in eating disorders, meeting the criteria for an AI Incident. The article also discusses the broader health system impact and societal harm, reinforcing the classification.[AI generated]
AI principles
SafetyHuman wellbeingTransparency & explainabilityAccountabilityRespect of human rightsDemocracy & human autonomy

Industries
Media, social platforms, and marketingHealthcare, drugs, and biotechnology

Affected stakeholders
Children

Harm types
PsychologicalPublic interestHuman or fundamental rights

Severity
AI incident

Business function:
Marketing and advertisementMonitoring and quality control

AI system task:
Organisation/recommenders


Articles about this incident or hazard

Thumbnail Image

Eating disorders double in a decade as experts warn TikTok raises risk

2024-08-19
Daily Mail Online
Why's our monitor labelling this an incident or hazard?
The article explicitly links TikTok's recommendation algorithm, an AI system, to the dissemination of harmful pro-anorexia content that negatively affects young women's body image and increases the risk of eating disorders. The harm (health injury to children and young women) is realized and ongoing, with increased waiting times for treatment exacerbating the issue. The AI system's role is pivotal in promoting harmful content, which contributes indirectly to the rise in eating disorders, meeting the criteria for an AI Incident. The article also discusses the broader health system impact and societal harm, reinforcing the classification.
Thumbnail Image

Eating Disorders Double In Less Than A Decade - Experts Warn Just A Few Minutes Of Scrolling On TikTok Increases Risk Of These Conditions - Ny Breaking News

2024-08-19
NY Breaking News
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions that TikTok's recommendation algorithm promoted content about self-harm and eating disorders within minutes of teens expressing interest, which is an AI system influencing user exposure to harmful content. This AI-driven promotion has been linked to increased risk of eating disorders, a serious health harm affecting children and young women. The harm is realized and ongoing, as evidenced by the doubling of eating disorders and expert warnings. Therefore, the event qualifies as an AI Incident due to direct harm caused by the AI system's use in content recommendation leading to health harm and harm to communities.
Thumbnail Image

"Rates of Child Eating Disorders Skyrocketing: Experts Caution Against TikTok's Influence" - Internewscast Journal

2024-08-19
Internewscast Journal
Why's our monitor labelling this an incident or hazard?
TikTok's recommendation algorithm is an AI system that curates content for users. The article highlights research and expert warnings that this AI-driven content curation can negatively affect body image and potentially increase the risk of eating disorders among young people. While the harm is not directly attributed to a specific AI malfunction or misuse event, the AI system's role in promoting harmful content plausibly leads to health harms. Therefore, this situation fits the definition of an AI Hazard, as the AI system's use could plausibly lead to an AI Incident (harm to health of children). There is no report of a realized AI Incident or direct harm caused by the AI system itself in this article, nor is the article primarily about governance or response measures, so it is not Complementary Information.