Celebrities Warn Against AI Deepfake Fraud in Endorsements

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

On May 18, Sun Li and Deng Chao’s studios condemned fake endorsement videos created using AI deepfake and voice synthesis, where their likenesses were used to falsely promote products like supplements and weight-loss drugs. Similar incidents involving other celebrities highlight the urgent need for stricter legal and platform controls.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event explicitly involves AI systems used to synthesize celebrity images and voices to create fake promotional videos, which have been disseminated online. This use of AI has directly led to harm by spreading false information and infringing on the celebrities' rights, as well as potentially deceiving consumers. The studios' response and legal actions confirm the harm has materialized. Therefore, this is an AI Incident due to realized harm from AI-generated deepfakes causing violations of rights and misleading the public.[AI generated]
AI principles
AccountabilityPrivacy & data governanceRespect of human rightsRobustness & digital securitySafetyTransparency & explainability

Industries
Media, social platforms, and marketingConsumer productsHealthcare, drugs, and biotechnology

Affected stakeholders
ConsumersOther

Harm types
Economic/PropertyReputationalHuman or fundamental rights

Severity
AI incident

Business function:
Marketing and advertisement

AI system task:
Content generation


Articles about this incident or hazard

Thumbnail Image

孙俪、邓超工作室齐发声!

2025-05-19
zx.sina.cn
Why's our monitor labelling this an incident or hazard?
The event explicitly involves AI systems used to synthesize celebrity images and voices to create fake promotional videos, which have been disseminated online. This use of AI has directly led to harm by spreading false information and infringing on the celebrities' rights, as well as potentially deceiving consumers. The studios' response and legal actions confirm the harm has materialized. Therefore, this is an AI Incident due to realized harm from AI-generated deepfakes causing violations of rights and misleading the public.
Thumbnail Image

孙俪、邓超工作室双双发声:都是假的!不要上当!_手机网易网

2025-05-18
m.163.com
Why's our monitor labelling this an incident or hazard?
The event involves AI systems used to create synthetic videos that misrepresent individuals to promote products falsely, leading to harm through deception and potential consumer fraud. This fits the definition of an AI Incident because the AI-generated content has directly led to harm (misleading consumers, potential financial harm, and violation of rights). The mention of regulatory measures and warnings supports the seriousness of the harm. Therefore, this is classified as an AI Incident.
Thumbnail Image

孙俪、邓超突发声明!_手机网易网

2025-05-21
m.163.com
Why's our monitor labelling this an incident or hazard?
The use of technology to synthetically generate videos and audio of celebrities endorsing products is indicative of AI systems (deepfake generation). The harm arises from the dissemination of false advertising and potential consumer fraud, which is a clear harm to communities and individuals. The event involves the use of AI systems to create and spread false content, leading to realized harm, thus qualifying as an AI Incident.
Thumbnail Image

孙俪在线打假AI虚假广告:务必警惕,都是骗人的!

2025-05-19
凤凰网(凤凰新媒体)
Why's our monitor labelling this an incident or hazard?
The event describes AI-generated fake videos using Sun Li's image and voice to produce false endorsements, which is a direct misuse of AI technology causing harm by misleading the public and potentially leading to fraud. The harm is realized as the public is warned against believing these videos to avoid scams. Therefore, this qualifies as an AI Incident due to the direct harm caused by AI-generated misinformation and impersonation leading to potential consumer fraud.
Thumbnail Image

邓超孙俪工作室齐发声打假 严正警告虚假信息传播者

2025-05-18
中华网科技公司
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of technical synthesis to create fake videos of celebrities endorsing products, which is a typical application of AI-based deepfake technology. The harm is realized as consumers are warned not to trust these videos to avoid being scammed, indicating actual misinformation and potential financial harm. The involvement of AI in generating these videos and the resulting harm to individuals and communities (through deception and fraud) meets the criteria for an AI Incident.
Thumbnail Image

孙俪邓超打假AI虚假广告 明星形象被盗用

2025-05-19
中华网科技公司
Why's our monitor labelling this an incident or hazard?
The event explicitly describes AI systems being used to synthesize celebrity images and voices to produce false advertising videos, which have been disseminated online. This misuse of AI directly leads to harm by deceiving consumers and infringing on the celebrities' rights. The involvement of AI in creating these fake videos and voices is clear, and the harm (misinformation, consumer deception, and rights violations) is occurring. Therefore, this qualifies as an AI Incident.
Thumbnail Image

孙俪、邓超,突发声明!

2025-05-18
扬子网(扬子晚报)
Why's our monitor labelling this an incident or hazard?
The event explicitly mentions the use of AI technology for face and voice synthesis to create fake videos that promote false products, which constitutes an AI system's use leading to harm. The harms include violation of personal rights (image and voice), deception of consumers, and potential health risks from misleading product claims. The event also references similar incidents involving other celebrities and exposes a broader pattern of AI misuse for fraudulent advertising. Therefore, this qualifies as an AI Incident due to the direct and realized harm caused by AI-generated fake content used in deceptive advertising.
Thumbnail Image

邓超、孙俪工作室发声:都是假的!不要相信!

2025-05-18
华龙网
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI-generated synthetic videos and text used to create false advertising and misinformation, which has caused harm by deceiving viewers and potentially damaging reputations and legal rights. This constitutes a violation of rights and harm to communities through misinformation. The involvement of AI in generating these fake videos and texts is clear, and the harm is realized as the public is warned not to trust these videos to avoid being scammed. Therefore, this qualifies as an AI Incident. The article also discusses regulatory responses, but the primary focus is on the realized harm caused by AI-generated fake content.
Thumbnail Image

孙俪、邓超工作室齐发声!

2025-05-18
新浪财经
Why's our monitor labelling this an incident or hazard?
The event involves AI systems used to synthetically generate fake videos and audio (deepfakes) impersonating public figures to promote products falsely. This misuse of AI has directly led to harm by spreading misinformation and potentially deceiving consumers, which can be considered a violation of intellectual property and personal rights. Therefore, this qualifies as an AI Incident due to realized harm caused by AI-generated fake content.
Thumbnail Image

邓超与孙俪工作室发文打假AI虚假广告

2025-05-19
新浪财经
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI-generated deepfake videos that use the celebrities' images and voices to promote products falsely. This misuse of AI technology has directly led to harm: consumers are misled into believing false endorsements, potentially causing financial loss and damage to trust, while the celebrities suffer violations of their portrait and voice rights. The harm is realized and ongoing, meeting the criteria for an AI Incident under violations of rights and harm to communities. The involvement of AI in the creation of these videos is clear and central to the incident.
Thumbnail Image

孙俪、邓超,突发声明!_手机网易网

2025-05-18
m.163.com
Why's our monitor labelling this an incident or hazard?
The event involves AI systems used to generate fake videos and audio impersonating celebrities without consent, leading to the dissemination of false advertising and misleading consumers. This directly breaches intellectual property and personal rights, and causes harm to communities by spreading misinformation and potential financial harm to consumers. Therefore, it qualifies as an AI Incident due to realized harm linked to AI misuse.