AI-Generated False Content Leads to Legal Action and Public Apology in China

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Li Auto reported a Jiangxi-based media company to police for using AI tools to batch-generate and spread false content, damaging the company's reputation and stigmatizing its user community. Authorities investigated, and the offending company issued a public apology. The incident highlights AI's role in malicious misinformation dissemination.[AI generated]

Why's our monitor labelling this an incident or hazard?

The use of AI tools to batch-generate false defamatory content that systematically harms a company's reputation and its user community constitutes an AI Incident under the framework. The AI system's misuse directly led to harm to the community (reputational damage and misinformation) and violation of rights (right to truthful information and protection from defamation). The legal and enforcement response confirms the harm is realized, not just potential. Therefore, this event qualifies as an AI Incident.[AI generated]
AI principles
AccountabilityTransparency & explainability

Industries
Media, social platforms, and marketing

Affected stakeholders
BusinessConsumers

Harm types
Reputational

Severity
AI incident

Business function:
Marketing and advertisement

AI system task:
Content generation


Articles about this incident or hazard

Thumbnail Image

坚决打击造谣:理想汽车起诉利用 AI 批量抹黑的传媒公司

2026-06-11
chinaz.com
Why's our monitor labelling this an incident or hazard?
The use of AI tools to batch-generate false defamatory content that systematically harms a company's reputation and its user community constitutes an AI Incident under the framework. The AI system's misuse directly led to harm to the community (reputational damage and misinformation) and violation of rights (right to truthful information and protection from defamation). The legal and enforcement response confirms the harm is realized, not just potential. Therefore, this event qualifies as an AI Incident.
Thumbnail Image

利用AI工具批量生成不实内容:某机构就造谣理想汽车公开道歉

2026-06-11
驱动之家
Why's our monitor labelling this an incident or hazard?
The use of AI tools to batch-generate false content that defames a company and its users is a clear case of AI system use leading to harm. The harm includes reputational damage and misinformation spread, which fits the definition of harm to communities and property. The involvement of law enforcement and public apology confirms the harm has materialized. Therefore, this event qualifies as an AI Incident.
Thumbnail Image

理想汽车:就江西一公司利用AI工具批量生成涉理想汽车不实内容一事正式报案 涉事机构已公开道歉

2026-06-11
凤凰网(凤凰新媒体)
Why's our monitor labelling this an incident or hazard?
The event explicitly involves the use of AI tools to generate false content in bulk, which has directly harmed the company's reputation and defamed its user community. The use of AI for malicious misinformation dissemination fits the definition of an AI Incident as it has directly led to harm to communities and violation of rights. The fact that the company has reported the matter to authorities and the offending party has apologized confirms the harm is realized and recognized. Hence, this is an AI Incident rather than a hazard or complementary information.
Thumbnail Image

理想汽车法务部:江西一公司用AI批量造谣,已报案

2026-06-11
凤凰网(凤凰新媒体)
Why's our monitor labelling this an incident or hazard?
The use of AI tools to batch-generate false content that damages a company's reputation and stigmatizes its user base fits the definition of an AI Incident, as it involves the use of an AI system leading directly to harm to communities and violation of rights. The legal response and public apology confirm the harm is realized, not just potential. Therefore, this event qualifies as an AI Incident.
Thumbnail Image

利用AI工具批量生成不实内容:某机构就造谣理想汽车公开道歉

2026-06-11
证券之星
Why's our monitor labelling this an incident or hazard?
The article explicitly states that an AI tool was used to batch-generate false content about the company, which was disseminated and caused reputational harm. This is a direct use of AI leading to harm (violation of rights and harm to community reputation). The harm has materialized, and legal authorities are involved, confirming the incident's seriousness. Therefore, this event meets the criteria for an AI Incident.
Thumbnail Image

理想汽车:已报案

2026-06-11
新浪新闻中心
Why's our monitor labelling this an incident or hazard?
An AI system was used maliciously to generate and disseminate false information, which directly harmed the company's reputation and its user community, constituting harm to communities and violation of rights. Since the harm has occurred and the AI system's use was pivotal in causing it, this qualifies as an AI Incident.
Thumbnail Image

理想汽车:已向警方报案

2026-06-12
新浪军事频道
Why's our monitor labelling this an incident or hazard?
The article explicitly states that an AI tool was used to batch generate false content about the company, which was then spread maliciously. This use of AI directly led to harm in the form of reputational damage and misinformation. The company has reported this to law enforcement, and the involved party has apologized, confirming the incident's occurrence. Hence, the event meets the criteria for an AI Incident due to realized harm caused by AI-generated disinformation.
Thumbnail Image

理想汽车:已向警方报案_京报网

2026-06-11
news.bjd.com.cn
Why's our monitor labelling this an incident or hazard?
An AI system (AI tools for batch generation of false content) is explicitly involved in the malicious creation and dissemination of misinformation that harms the company and its user community. This constitutes harm to communities and reputational harm, fitting the definition of an AI Incident. The event is not merely a potential risk but describes realized harm and active legal response, so it is not a hazard or complementary information but an AI Incident.
Thumbnail Image

理想汽车,已正式报案_手机网易网

2026-06-11
m.163.com
Why's our monitor labelling this an incident or hazard?
The use of AI tools to batch-generate false content that damages a company's reputation and misleads the public fits the definition of an AI Incident, as it involves the use of an AI system leading directly to harm to communities and violation of rights. The harm is realized (not just potential), and the event involves the use of AI in a harmful way. Therefore, this is classified as an AI Incident.
Thumbnail Image

理想汽车:已向警方报案

2026-06-12
businessstudies.qianlong.com
Why's our monitor labelling this an incident or hazard?
The event explicitly involves the use of AI tools to generate false content, which is a misuse of AI technology. The false information has been spread in large volumes, causing harm to the targeted company and misleading the public. The involvement of law enforcement and public apology confirms that harm has occurred and the AI system's misuse is pivotal to the incident. Therefore, this meets the criteria for an AI Incident due to violations related to misinformation and harm to communities and reputation.