AI-Generated Fake Images Used in E-Commerce Refund Fraud in China

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

In China, e-commerce merchants are facing a surge in fraudulent refund claims using AI-generated fake images as evidence of product defects. This misuse of AI has led to financial losses and operational disruptions for sellers. In response, authorities have launched AI-powered detection tools to identify and counteract such scams.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves AI systems generating fake images used in fraudulent refund claims, which directly harms sellers financially and disrupts e-commerce operations. The AI content detection tool is an AI system used to identify such fraudulent AI-generated content, addressing the harm. Since the harm is realized and directly linked to AI-generated content, this qualifies as an AI Incident. The article also discusses mitigation efforts but the primary focus is on the harm caused by AI-generated fake images and the resulting fraud.[AI generated]
AI principles
AccountabilityTransparency & explainability

Industries
Consumer services

Affected stakeholders
Business

Harm types
Economic/Property

Severity
AI incident

AI system task:
Content generation


Articles about this incident or hazard

Thumbnail Image

"AI内容鉴定"!国家反诈中心App上线新功能

2026-05-18
21jingji.com
Why's our monitor labelling this an incident or hazard?
The event involves AI systems generating fake images used in fraudulent refund claims, which directly harms sellers financially and disrupts e-commerce operations. The AI content detection tool is an AI system used to identify such fraudulent AI-generated content, addressing the harm. Since the harm is realized and directly linked to AI-generated content, this qualifies as an AI Incident. The article also discusses mitigation efforts but the primary focus is on the harm caused by AI-generated fake images and the resulting fraud.
Thumbnail Image

AI假图"仅退款"成风:商家叫苦不迭,国家反诈中心"AI鉴定师"进入实战阶段

2026-05-17
凤凰网(凤凰新媒体)
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI systems being used to generate fake images as fraudulent evidence in consumer refund claims, which directly harms merchants financially and disrupts e-commerce operations. This fits the definition of an AI Incident because the AI system's use has directly led to harm (economic loss and disruption). The article also discusses AI detection tools as a response, but the primary focus is on the harm caused by AI-generated fake images. Hence, the event is classified as an AI Incident.
Thumbnail Image

【详细】

2026-05-15
四川在线
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of AI systems for detecting AI-generated images and videos, which are used in new types of fraud and scams. The AI system's use here is to identify and prevent harm related to AI-generated fraudulent content, which is a form of harm to communities and individuals (fraud and deception). However, the article does not report any actual harm caused by the AI system itself, nor does it describe a malfunction or misuse of the AI system. Instead, it describes a new AI tool deployed to reduce harm from AI-generated fraud. Therefore, this event is best classified as Complementary Information, as it provides an update on societal and technical responses to AI-related harms rather than describing a new AI Incident or AI Hazard.
Thumbnail Image

AI伪造图骗"仅退款"事件频发 如何让有图依然有真相?

2026-05-17
新浪财经
Why's our monitor labelling this an incident or hazard?
The event explicitly involves AI systems generating fake images that are used to commit fraud, directly causing economic harm to merchants and disrupting e-commerce operations, which fits the definition of harm to communities or property. The AI system's use in generating deceptive content is central to the harm. The deployment of AI detection tools is complementary information but does not negate the fact that the fraudulent use of AI-generated images is causing actual harm. Hence, this is an AI Incident rather than a hazard or complementary information.
Thumbnail Image

AI假图仅退款成风:国家反诈中心上线AI内容鉴定功能

2026-05-17
k.sina.com.cn
Why's our monitor labelling this an incident or hazard?
The event involves AI systems generating fake images used in fraudulent refund claims, which directly harms sellers financially and disrupts normal commerce, fitting the definition of an AI Incident due to harm to communities and property. The article also discusses the use of AI detection tools to identify such fake content, which is complementary information about responses to the incident. Since the primary focus is on the harm caused by AI-generated fake images and the resulting fraud, this qualifies as an AI Incident.
Thumbnail Image

AI伪造图骗"仅退款"事件频发,如何让有图依然有真相?

2026-05-17
news.bjd.com.cn
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems to generate fake images that deceive e-commerce platforms into approving fraudulent refund claims, which constitutes direct harm to merchants (harm to property and economic interests). The AI system's use is central to the harm, fulfilling the criteria for an AI Incident. The deployment of AI detection tools is a response to this incident and does not negate the classification as an incident. Therefore, this event is best classified as an AI Incident.
Thumbnail Image

"AI内容鉴定"!国家反诈中心App上线新功能

2026-05-18
news.bjd.com.cn
Why's our monitor labelling this an incident or hazard?
The event involves AI systems generating fake images used in fraudulent refund claims, directly causing financial harm to sellers, which fits the definition of an AI Incident (harm to property and communities). The article also mentions AI detection tools as a response, but the primary focus is on the realized harm caused by AI-generated fake content. Hence, this is not merely a hazard or complementary information but an AI Incident due to the direct harm caused by AI misuse.