TikTok's AI-Driven Features Raise Privacy and Manipulation Concerns

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

TikTok's AI-powered recommendation algorithm and new emotion-tracking ad feature have raised significant concerns about privacy, potential political manipulation, and violations of rights. While no direct harm has been confirmed, the large-scale use of these AI systems poses credible risks of privacy breaches and community-level harm, especially among minors.[AI generated]

Why's our monitor labelling this an incident or hazard?

The TikTok recommendation algorithm is an AI system that shapes user content exposure. The article details concerns and experimental evidence suggesting possible suppression of political content, which could influence public opinion and elections, a harm to communities. However, the evidence is inconclusive and no direct harm has been confirmed. The complexity and opacity of the AI system make oversight challenging, increasing the risk of undetected manipulation. Since the harm is plausible but not confirmed, this event fits the definition of an AI Hazard rather than an AI Incident. It is not merely complementary information because the focus is on the potential for harm from the AI system's operation, not just responses or updates.[AI generated]
AI principles
Privacy & data governanceRespect of human rightsDemocracy & human autonomy

Industries
Media, social platforms, and marketing

Affected stakeholders
ConsumersChildrenGeneral public

Harm types
Human or fundamental rightsPublic interest

Business function:
Marketing and advertisement

AI system task:
Organisation/recommendersRecognition/object detection


Articles about this incident or hazard