AI Algorithms in Short Video Platforms Cause Cognitive Harm and Misinformation

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

AI-driven recommendation algorithms on short video platforms in China are causing addictive behaviors and cognitive harm among users. Additionally, AI-generated deepfake videos, such as a manipulated robot coffee art video, have spread misinformation online, misleading the public. These incidents highlight the societal risks of AI misuse in media and information dissemination.[AI generated]

Why's our monitor labelling this an incident or hazard?

The short video platforms use AI systems (recommendation algorithms) that analyze user preferences to continuously push tailored content, causing addictive behaviors and cognitive harms. These harms are realized and directly linked to the AI system's use. Therefore, this qualifies as an AI Incident due to the direct harm to users' cognitive health and behavior caused by the AI system's operation.[AI generated]
AI principles
Human wellbeingTransparency & explainability

Industries
Media, social platforms, and marketing

Affected stakeholders
ConsumersGeneral public

Harm types
PsychologicalPublic interest

Business function:
Marketing and advertisement

AI system task:
Organisation/recommendersContent generation


Articles about this incident or hazard