TikTok Scales Back AI Video Summaries After Generating Bizarre Errors

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

TikTok scaled back its experimental AI Overviews feature after it generated wildly inaccurate and bizarre video summaries, such as describing Charli D'Amelio as a "collection of blueberries." The malfunction led to widespread misinformation and reputational harm, prompting TikTok to limit the feature's scope.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves an AI system (the AI-generated video overview feature) that malfunctioned by producing incorrect and misleading content summaries. This malfunction directly led to harm in the form of misinformation and reputational damage to individuals featured in the videos. Since the harm has occurred and the AI system's malfunction is central to the issue, this qualifies as an AI Incident.[AI generated]
AI principles
SafetyRobustness & digital security

Industries
Media, social platforms, and marketing

Affected stakeholders
WomenGeneral public

Harm types
ReputationalPublic interest

AI system task:
Content generation


Articles about this incident or hazard