人民直击｜AI客服的承诺，算数吗？
2026-11-02
人民网
The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
In China, AI customer service systems have misled consumers with inaccurate promises, such as incorrect fee information, resulting in financial loss and unmet expectations. Consumers also face difficulties accessing human agents. These issues have led to increased complaints and prompted new national standards requiring clearer human-AI service coordination.[AI generated]
Why's our monitor labelling this an incident or hazard?
The article explicitly involves AI systems deployed as customer service agents that provide information and make commitments affecting consumer decisions. The AI's misleading or incorrect responses have caused consumer harm, such as financial loss or unmet expectations, which are violations of consumer rights and legal obligations. The difficulties in accessing human customer service further exacerbate the harm. The involvement of AI in these harms is direct, as the AI outputs are part of the service and influence consumer behavior. The article also discusses legal and regulatory responses, but the primary focus is on the realized harm caused by AI customer service. Hence, this qualifies as an AI Incident rather than a hazard or complementary information.[AI generated]