TikTok's AI 'Fatphobic' Filter Sparks Body-Shaming Backlash

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

TikTok's AI-powered 'fatphobic' filter, which exaggerated facial features to appear 'ugly,' went viral but was widely criticized for promoting body-shaming and fatphobia. The filter's use led to psychological and social harm, prompting TikTok to remove it following significant user backlash.[AI generated]

Why's our monitor labelling this an incident or hazard?

The filter is an AI system that manipulates images to create exaggerated facial features. Its use in a social media trend directly leads to harm by promoting fatphobia and making people feel insecure, which constitutes harm to communities. Therefore, this qualifies as an AI Incident due to the realized harm caused by the AI system's use.[AI generated]
AI principles
FairnessHuman wellbeingRespect of human rightsSafetyAccountabilityTransparency & explainability

Industries
Media, social platforms, and marketingConsumer services

Affected stakeholders
Consumers

Harm types
PsychologicalReputationalHuman or fundamental rights

Severity
AI incident

Business function:
Marketing and advertisement

AI system task:
Recognition/object detectionContent generation


Articles about this incident or hazard

Thumbnail Image

A 'fatphobic' new filter has appeared on TikTok and honestly, it's disgusting

2022-08-05
The Tab
Why's our monitor labelling this an incident or hazard?
The filter is an AI system that manipulates images to create exaggerated facial features. Its use in a social media trend directly leads to harm by promoting fatphobia and making people feel insecure, which constitutes harm to communities. Therefore, this qualifies as an AI Incident due to the realized harm caused by the AI system's use.
Thumbnail Image

The "fatphobic" filter on TikTok, which inflates faces to see how you would look "ugly," has drawn criticism. | Nokia News

2022-08-03
Nokia News |
Why's our monitor labelling this an incident or hazard?
The filter is an AI system that manipulates facial images to produce altered appearances. Its use has directly led to harm in the form of psychological distress and social harm to individuals and communities, as evidenced by user criticism and emotional responses. This constitutes harm to communities and individuals' well-being, fitting the definition of an AI Incident. The removal of the filter indicates recognition of the harm caused.
Thumbnail Image

TikTok slammed over 'fatphobic' filter, makes you look 'ugly'

2022-08-03
Daily Mail Online
Why's our monitor labelling this an incident or hazard?
The event involves an AI system (the facial modification filter) whose use directly led to social and psychological harm, including body shaming and fatphobia, which are violations of rights and harm to communities. The filter's outputs caused distress and backlash, and the platform removed it in response. This meets the criteria for an AI Incident because the AI system's use has directly led to harm (psychological and social).
Thumbnail Image

TikTok slammed for 'fatphobic' filter: 'Why are you shaming fat...

2022-08-04
New York Post
Why's our monitor labelling this an incident or hazard?
The filter is an AI system that modifies facial features, and its use has directly led to social harm by promoting fatphobia and body shaming, which are violations of rights and harm to communities. The public backlash and the filter's removal confirm that harm occurred. Additionally, the platform's algorithmic content moderation practices have been criticized for fatphobic bias, further supporting the classification as an AI Incident. The event meets the criteria for AI Incident as the AI system's use has directly led to harm to communities and violations of rights.
Thumbnail Image

'Yea let's not do this': TikTok filter called out for popularizing fatphobic trend

2022-08-03
The Daily Dot
Why's our monitor labelling this an incident or hazard?
The TikTok filter uses AI to alter facial images, which qualifies as an AI system. The event focuses on the social criticism of the filter popularizing a fatphobic trend, which is a societal concern. However, there is no explicit or implicit indication that the AI system's use has directly or indirectly caused harm as defined (such as injury, rights violations, or community harm) or that it could plausibly lead to such harm. The content is about public reaction and cultural impact, fitting the definition of Complementary Information rather than an Incident or Hazard.
Thumbnail Image

TikTok slammed for 'fatphobic' filter trend that encourages 'body shaming'

2022-08-04
indy100.com
Why's our monitor labelling this an incident or hazard?
The TikTok filter is an AI system that modifies facial images in real time, and its use has directly led to social harm by promoting fatphobia and body shaming, which harms communities and individuals psychologically and socially. The harm is realized and widespread, as evidenced by the backlash and critical responses from users. This fits the definition of an AI Incident because the AI system's use has directly led to harm to communities (psychological and social harm).
Thumbnail Image

TikTokers Called Out For Perpetuating Harmful Body-Shaming With Trend Using 'Fatphobic' Filter

2022-08-05
Comic Sands
Why's our monitor labelling this an incident or hazard?
The TikTok filter is an AI system that manipulates facial images to create a harmful visual effect. Its use in a viral trend has directly led to social harm by encouraging fatphobia and body-shaming, which are violations of rights and cause harm to communities. The filter's deletion indicates recognition of the harm caused. Therefore, this event meets the criteria for an AI Incident due to realized harm stemming from the AI system's use.