Chinese Users Report Widespread Harm from Algorithmic Recommendations

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Over 70% of Chinese users report being troubled by AI-driven recommendation algorithms, citing harms such as privacy violations, discriminatory pricing, addictive content, and the creation of information cocoons. These AI systems, used by commercial platforms to maximize profit, often disregard user well-being and fairness, leading to significant societal concerns.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly describes AI systems (algorithms) used for personalized content and price recommendations that have directly led to harms including violation of consumer rights (e.g., price discrimination), harm to communities (information cocoons and manipulation), and privacy breaches. The harms are ongoing and realized, not just potential. Therefore, this qualifies as an AI Incident under the framework because the AI system's use has directly led to significant harms. The article also discusses regulatory and societal responses, but the main focus is on the harms caused by algorithmic use, not just complementary information or general AI news.[AI generated]
AI principles
FairnessHuman wellbeingPrivacy & data governanceDemocracy & human autonomy
Industries
Media, social platforms, and marketing
Affected stakeholders
Consumers
Harm types
Human or fundamental rightsEconomic/PropertyPsychologicalPublic interest
Business function:
Marketing and advertisement
AI system task:
Organisation/recommenders

Articles about this incident or hazard