Celebrity AI Deepfake Incident Sparks Legal Action

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Chinese actress Zhang Xinyu announced on April 18 that brands used AI to clone her voice and produce unauthorized weight loss drug ads, violating her intellectual property rights. The incident has fueled concerns over deepfakes and misinformation, prompting her to vow full legal action.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves the use of AI technology to clone a person's voice and produce fake advertisements without consent. This misuse of AI directly leads to harm by misleading consumers and violating the celebrity's rights. Therefore, it qualifies as an AI Incident due to the realized harm from unauthorized AI-generated content causing reputational and potential economic damage.[AI generated]
AI principles
Privacy & data governanceRespect of human rightsTransparency & explainabilityAccountability

Industries
Media, social platforms, and marketingHealthcare, drugs, and biotechnology

Affected stakeholders
Women

Harm types
ReputationalEconomic/PropertyHuman or fundamental rights

Severity
AI incident

Business function:
Marketing and advertisement

AI system task:
Content generation


Articles about this incident or hazard

Thumbnail Image

女星張馨予發文打假:有品牌AI復制我的聲音 很惡劣追究到底!

2025-04-19
std.stheadline.com
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI technology to clone a person's voice and produce fake advertisements without consent. This misuse of AI directly leads to harm by misleading consumers and violating the celebrity's rights. Therefore, it qualifies as an AI Incident due to the realized harm from unauthorized AI-generated content causing reputational and potential economic damage.
Thumbnail Image

演员张馨予发文打假:有品牌AI复制我的声音,很恶劣,追究到底!

2025-04-19
yangtse.com
Why's our monitor labelling this an incident or hazard?
An AI system was used to clone the actress's voice and generate fake advertisements without authorization, which is a misuse of AI technology leading to harm. The harm includes violation of rights and misleading consumers, which fits the definition of an AI Incident. The event describes realized harm caused by the AI system's use, not just a potential risk, so it is classified as an AI Incident.
Thumbnail Image

张馨予被AI复制!推销减肥药

2025-04-19
finance.sina.com.cn
Why's our monitor labelling this an incident or hazard?
The event involves AI systems used to synthesize celebrity voices and videos without authorization, which directly leads to harm by spreading false advertisements and misleading the public. This misuse of AI technology results in reputational damage to the celebrities and potential consumer harm from fraudulent products. Therefore, it meets the criteria of an AI Incident due to realized harm caused by AI-generated deceptive content.
Thumbnail Image

张馨予:一定追究到底 2025-04-18

2025-04-18
news.ycwb.com
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI technology to clone a person's voice without authorization to produce fabricated advertisements, which is a direct misuse of AI systems leading to harm. The harm includes violation of the actress's rights (unauthorized use of her voice and false endorsement) and potential harm to consumers misled by the ads. Therefore, this qualifies as an AI Incident because the AI system's use has directly led to harm through unauthorized and deceptive content.
Thumbnail Image

知名女演员紧急打假:很恶劣!追究到底!

2025-04-18
finance.sina.com.cn
Why's our monitor labelling this an incident or hazard?
The event explicitly mentions the use of AI to clone the actress's voice and produce unauthorized advertisements, which constitutes misuse of an AI system. The resulting harm includes deception of the public and potential damage to the actress's reputation and rights. Since the AI system's use has directly led to these harms, this qualifies as an AI Incident under the framework definitions.
Thumbnail Image

张馨予称AI伪造其声音带货减肥药,换脸拟声的欺骗何时休?

2025-04-18
news.ycwb.com
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI systems being used to clone voices and generate deepfake videos of celebrities without authorization, which are then used to promote products falsely. This misuse of AI has directly caused harm by deceiving consumers, infringing on personal rights, and potentially causing financial and reputational damage. The involvement of AI in the creation and dissemination of these fake endorsements is central to the harm described. Hence, the event meets the criteria for an AI Incident as the AI system's use has directly led to violations of rights and consumer harm.
Thumbnail Image

女星张馨予发声打假:从来没有推荐过任何减肥药,有商家利用AI技术非法剪辑投放广告,我一定追究到底

2025-04-18
finance.sina.com.cn
Why's our monitor labelling this an incident or hazard?
The event explicitly mentions the use of AI technology to illegally clone the celebrity's voice and create fake advertisements without authorization. This misuse of AI has directly led to harm in the form of false advertising and violation of the celebrity's rights. Therefore, it meets the criteria of an AI Incident as the AI system's use has directly caused harm through unauthorized content generation and dissemination.
Thumbnail Image

张馨予,突然发声!"很恶劣 、追究到底"

2025-04-18
finance.sina.com.cn
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems for deepfake voice synthesis to create unauthorized advertisements, which directly harms the individual's rights and potentially misleads consumers, constituting a violation of personal rights and intellectual property. The harm is realized as the AI-generated content is actively used in the market, causing reputational damage and consumer deception. Therefore, this qualifies as an AI Incident due to the direct harm caused by the AI system's misuse. The broader context of AI-generated misinformation and regulatory responses supports the assessment but does not change the primary classification.
Thumbnail Image

张馨予,突然发声!"很恶劣 、追究到底

2025-04-18
cj.sina.com.cn
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems for deepfake voice synthesis to create unauthorized advertisements, which directly harms the celebrity's rights and misleads the public. This fits the definition of an AI Incident because the AI system's use has directly led to harm, including violation of personal rights and potential consumer deception. The article also discusses the broader context of AI-generated misinformation and regulatory measures, but the primary focus is on the realized harm caused by the AI misuse in this specific case.
Thumbnail Image

知名女星发文打假:这种行为很恶劣,称一定追究到底! 2025-04-19 08:14

2025-04-19
nbd.com.cn
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems to create unauthorized synthetic media (voice and video) that misrepresent a public figure, leading to harm through false advertising and potential consumer fraud. This misuse directly causes reputational damage and violates the celebrity's rights, fitting the definition of an AI Incident. The article's focus on actual harm caused by AI-generated fake content and the intent to pursue legal action confirms this classification. The broader discussion of AI deepfake risks supports the context but does not change the primary classification.
Thumbnail Image

你的耳朵被"偷"了吗?张馨予发声揭露AI换声黑产,网友:我也刷到过!

2025-04-19
finance.sina.com.cn
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of AI to copy Zhang Xinyu's voice without authorization to produce fabricated advertisements, which is a direct misuse of AI technology causing harm. The harm includes violation of personal rights (unauthorized use of voice), potential consumer deception (misleading ads), and reputational damage. Since the AI system's use has directly led to these harms, this qualifies as an AI Incident under the framework.
Thumbnail Image

演员张馨予发文打假:很恶劣,追究到底!

2025-04-19
app.myzaker.com
Why's our monitor labelling this an incident or hazard?
The event explicitly involves AI systems used to clone a celebrity's voice and create fake advertisements without authorization, leading to deception and potential consumer harm. The harm includes violation of intellectual property and personal rights, as well as harm to communities through fraudulent advertising. The involvement of AI in the malicious creation and dissemination of these fake videos and audio is direct and has already caused harm, meeting the criteria for an AI Incident rather than a hazard or complementary information.
Thumbnail Image

张馨予称被AI复制声音卖减肥药,曾因减肥话题多次登上热搜

2025-04-19
finance.sina.com.cn
Why's our monitor labelling this an incident or hazard?
The event involves AI systems that clone voices and generate fake videos, which are then used to create misleading advertisements without the celebrities' consent. This unauthorized use constitutes a violation of personal rights and intellectual property rights. The harm is realized as the fake ads are actively disseminated, misleading consumers and damaging the celebrities' reputations. Therefore, this qualifies as an AI Incident because the AI system's use has directly led to harm through unauthorized and deceptive content creation and distribution.
Thumbnail Image

知名女星紧急发声!雷军、刘德华都是受害者

2025-04-19
finance.sina.com.cn
Why's our monitor labelling this an incident or hazard?
The event involves AI systems used to generate synthetic voices and videos without consent, leading to violations of personal rights and potential consumer harm through deceptive advertising and scams. The harms are realized as the public is misled and celebrities' rights are infringed. The article also discusses governance responses, but the primary focus is on the ongoing incidents of AI misuse causing harm. Therefore, this qualifies as an AI Incident due to direct harm caused by AI-generated content impersonating individuals and facilitating fraud.
Thumbnail Image

利用AI模仿演员声音卖减肥药侵权 明星发声谴责

2025-04-20
news.china.com
Why's our monitor labelling this an incident or hazard?
The event explicitly involves the use of AI to synthesize a celebrity's voice without consent, leading to unauthorized commercial use and consumer deception. This infringes on the celebrity's legal voice rights and misleads consumers into buying potentially harmful products, which can cause health harm. The AI system's misuse directly causes these harms, meeting the criteria for an AI Incident under violations of rights and harm to health.