儿童手表对中国人评价引热议 小天才：回复内容来自于小度
2024-08-30
凤凰网（凤凰新媒体）
The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
Chinese AI-powered children’s smartwatches and learning devices generated offensive and false responses—insulting Chinese people’s intelligence, slandering Mao Zedong, denying the Nanjing Massacre, and rabble-rousing cultural falsehoods. Manufacturers 360, Xiaomi and Little Genius blamed third-party data or unofficial firmware, removed the content and promised enhanced AI moderation and software updates.[AI generated]
Why's our monitor labelling this an incident or hazard?
The children's smartwatches use AI systems (including third-party AI software) to generate responses to user queries. The offensive and discriminatory answers given by these AI systems have directly caused harm by spreading harmful stereotypes and potentially damaging social cohesion and individual dignity, which falls under harm to communities and violation of rights. The companies have acknowledged the issue and taken remedial action by removing the problematic responses. Since the harm has occurred and is directly linked to the AI systems' outputs, this event is classified as an AI Incident.[AI generated]