AI Deepfake Video of Celebrity Sparks Legal and Social Backlash in China

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A Chinese special effects creator used AI deepfake technology to insert himself into romantic scenes with a famous actress, leading to widespread online controversy, legal concerns over copyright and portrait rights violations, and physical assault by fans. The incident highlights the harms caused by unauthorized AI-generated content.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly involves AI systems used for face-swapping and synthetic video generation, which have directly led to violations of intellectual property rights and portrait rights of celebrities. These are recognized harms under the framework (violations of human rights and intellectual property rights). Although the sexual harassment aspect is debated and likely not met legally, the unauthorized use and dissemination of AI-generated synthetic videos constitute an AI Incident due to the infringement of rights and harm caused. Hence, the event qualifies as an AI Incident rather than a hazard or complementary information.[AI generated]
AI principles
Privacy & data governanceRespect of human rightsTransparency & explainabilityAccountabilitySafetyRobustness & digital securityHuman wellbeing

Industries
Media, social platforms, and marketingArts, entertainment, and recreation

Affected stakeholders
WomenWorkers

Harm types
Human or fundamental rightsReputationalPsychologicalPhysical (injury)Economic/Property

Severity
AI incident

AI system task:
Content generation


Articles about this incident or hazard

Thumbnail Image

合成与女星亲密视频是隔空性骚扰吗?律师解读

2023-03-27
china.org.cn/china.com.cn(中国网)
Why's our monitor labelling this an incident or hazard?
The article explicitly involves AI systems used for face-swapping and synthetic video generation, which have directly led to violations of intellectual property rights and portrait rights of celebrities. These are recognized harms under the framework (violations of human rights and intellectual property rights). Although the sexual harassment aspect is debated and likely not met legally, the unauthorized use and dissemination of AI-generated synthetic videos constitute an AI Incident due to the infringement of rights and harm caused. Hence, the event qualifies as an AI Incident rather than a hazard or complementary information.
Thumbnail Image

男子回应合成迪丽热巴视频来龙去脉:不想跟其他博主同质化

2023-03-29
驱动之家
Why's our monitor labelling this an incident or hazard?
The event describes the creation and dissemination of a synthetic video using AI-based special effects (deepfake) technology, which manipulates original video content to replace a character with another person. This use of AI has caused harm by infringing on the celebrity's portrait rights and potentially damaging her reputation, as noted by legal experts. The harm is realized and ongoing, as the video has sparked controversy and legal concerns. Therefore, this qualifies as an AI Incident due to violation of rights and harm to reputation caused by AI-generated manipulated content.
Thumbnail Image

男网红称因合成与女星接吻视频被打破相:律师称涉侵犯肖像权

2023-03-27
驱动之家
Why's our monitor labelling this an incident or hazard?
The event describes the use of AI-based face-swapping technology to create synthetic videos, which is an AI system's use. The resulting backlash caused physical harm to the content creator, fulfilling the harm criteria. The legal concerns about portrait rights further confirm the AI system's role in causing violations of rights. Hence, this is an AI Incident as the AI system's use directly led to harm and legal issues.
Thumbnail Image

男网红合成与热巴激吻视频被打,网友:这是不是隔空性骚扰

2023-03-27
凤凰网(凤凰新媒体)
Why's our monitor labelling this an incident or hazard?
The event explicitly involves the use of AI technology (AI face swap/deepfake) to create a synthetic video that falsely depicts a sexual act involving a real person without consent. This constitutes a violation of personal rights and can be considered a form of sexual harassment or defamation. The resulting social backlash includes physical harm to the video creator, indicating direct harm linked to the AI system's use. Hence, it meets the criteria for an AI Incident due to realized harm stemming from AI-generated manipulated content.
Thumbnail Image

法治课|特效师深度合成与明星亲密视频,侵犯了哪些权利?_一号专案_澎湃新闻-The Paper

2023-03-27
The Paper
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems for deepfake video creation, which is explicitly described. The AI system's use directly led to harm including violation of portrait rights, defamation (reputation harm), personality rights, and copyright infringement. The article details the legal and social consequences of these harms, including potential criminal liability. Therefore, this qualifies as an AI Incident because the AI system's use directly caused realized harm to individuals' rights and reputations, as well as intellectual property rights violations.
Thumbnail Image

男网红合成与迪丽热巴亲吻视频,自称被粉丝找上门打了!这算不算“隔空猥亵”? 2023-03-28 19:21

2023-03-28
每日经济新闻
Why's our monitor labelling this an incident or hazard?
The event explicitly involves the use of AI-based face-swapping technology to create manipulated videos without consent, infringing on the rights of the female celebrity and causing reputational and psychological harm. The AI system's use directly led to these harms, fulfilling the criteria for an AI Incident. The discussion by legal experts confirms the violation of portrait and personality rights, and the social consequences including physical assault on the creator further demonstrate realized harm. Hence, this is not merely a potential hazard or complementary information but a clear AI Incident.
Thumbnail Image

合成与女明星亲密视频,算“隔空猥亵”吗?国家网信办:严打“隔空猥亵”! 2023-03-28 14:30

2023-03-28
每日经济新闻
Why's our monitor labelling this an incident or hazard?
The event explicitly involves AI technology for video synthesis (deepfake-like manipulation) to create false intimate videos of a celebrity, which infringes on her rights and dignity, constituting harm under the framework. The AI system's use directly leads to this harm. The article also discusses legal and regulatory responses, but the primary focus is on the incident of rights violation caused by AI misuse. Hence, it is an AI Incident rather than a hazard or complementary information.
Thumbnail Image

特效师合成视频“与女明星接吻”遭粉丝殴打,孰对孰错?

2023-03-27
扬子网(扬子晚报)
Why's our monitor labelling this an incident or hazard?
The event explicitly describes the use of deep synthesis (deepfake) AI technology to create manipulated videos that infringe on celebrities' portrait and reputation rights and copyright holders' rights, which constitutes a violation of legal and human rights protections. The AI system's use directly led to social harm and legal violations, fulfilling the criteria for an AI Incident. The physical assault on the content creator, while illegal, is a consequence of the AI-generated content's impact. The event is not merely a potential risk but a realized harm involving AI misuse.
Thumbnail Image

AI换脸与迪丽热巴接吻 网红被粉丝打伤

2023-03-28
早报
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI for face-swapping (deepfake) technology to create manipulated video content. The AI system's use indirectly led to physical harm (injury) to the individual who made the video, as he was attacked by others in response to the content. This fits the definition of an AI Incident because the AI system's use directly or indirectly caused injury to a person.
Thumbnail Image

男网红合成与知名女星接吻视频 自述惹怒女星粉丝被打

2023-03-27
杭州网
Why's our monitor labelling this an incident or hazard?
The event explicitly involves AI technology (deepfake synthesis) used to create unauthorized and realistic videos of a celebrity, constituting a violation of her portrait rights under applicable law. The AI system's use directly led to harm: infringement of rights and social harm including fan violence. Therefore, this qualifies as an AI Incident because the AI system's use directly caused harm to individuals and communities. The physical assault on the creator is also a harm linked indirectly to the AI system's use. The event is not merely a potential risk but a realized harm scenario involving AI misuse.
Thumbnail Image

用AI换脸和迪丽热巴“亲吻” 这位特效师已涉嫌侵权

2023-03-27
华商网
Why's our monitor labelling this an incident or hazard?
The event explicitly involves AI face-swapping technology (an AI system) used to alter copyrighted video content and create misleading depictions of actors, which infringes on copyright and potentially harms the actors' reputations. The AI system's use directly caused these harms. The physical assault on the AI user is an indirect consequence of the AI misuse. The legal expert's analysis confirms multiple legal violations linked to the AI system's use. Hence, the event meets the criteria for an AI Incident due to realized harm to intellectual property rights, reputational harm, and social harm resulting from the AI system's use.
Thumbnail Image

男网红合成与女明星亲密视频引争议!娱乐有度 不能越界

2023-03-29
华商网
Why's our monitor labelling this an incident or hazard?
The event explicitly involves the use of AI-based deepfake technology to create manipulated videos that infringe on the rights of female celebrities, constituting violations of portrait rights and reputation rights, and potentially sexual harassment. These harms are realized and have legal implications as described by lawyers. Additionally, the physical assault on the internet celebrity is a direct consequence of the AI-generated content. Thus, the AI system's use has directly led to multiple harms, meeting the criteria for an AI Incident.
Thumbnail Image

用AI换脸让自己和迪丽热巴"亲吻",这位特效师已涉嫌侵权

2023-03-27
163.com
Why's our monitor labelling this an incident or hazard?
The event explicitly involves AI face-swapping technology (an AI system) used to create manipulated videos without authorization, leading to direct harm: infringement of the actress's personal and reputational rights, copyright violations of the original TV content, and social harm to the special effects artist himself (physical assault). The AI system's use is central to the incident, and the harms are realized, not just potential. Therefore, this qualifies as an AI Incident under the framework, as it involves direct harm to persons and violations of intellectual property rights caused by the AI system's use.
Thumbnail Image

"AI黄谣"泛滥,科技不应成为作恶"刀柄"_辣言辣语_红辣椒评论

2023-03-28
红网
Why's our monitor labelling this an incident or hazard?
The event explicitly involves AI deepfake technology used to create manipulated videos that infringe on the celebrity's portrait and reputation rights, causing direct harm to the individual and social harm to communities. The AI system's use is central to the harm, fulfilling the criteria for an AI Incident. The article details actual harm (defamation, psychological damage, social harm) resulting from the AI system's misuse, not just potential harm. Hence, it is classified as an AI Incident rather than a hazard or complementary information.
Thumbnail Image

"特效合成"不能沦为肆意侵权的工具

2023-03-29
华声在线
Why's our monitor labelling this an incident or hazard?
The event involves an AI system (deep synthesis technology) used to create manipulated videos without consent, infringing on portrait rights and copyright, which are violations of human rights and intellectual property rights. The harm is realized as the videos have been widely disseminated and caused public controversy, thus meeting the criteria for an AI Incident. The article also discusses legal responses and regulatory frameworks, but the primary focus is on the incident of unauthorized AI-generated content causing harm.
Thumbnail Image

合成与女星亲密视频是隔空性骚扰吗?律师解读

2023-03-27
China News
Why's our monitor labelling this an incident or hazard?
The event explicitly involves AI systems used for face-swapping to create synthetic videos, which directly leads to violations of intellectual property rights (modification and unauthorized dissemination of copyrighted content) and personal rights (unauthorized use of actors' images). These harms fall under violations of intellectual property and personal rights, which are covered under AI Incident criteria (c). Although sexual harassment is debated, the primary harm is the unauthorized AI-generated content causing rights violations. Therefore, this is classified as an AI Incident due to realized harm caused by AI system use.
Thumbnail Image

换脸与热巴"亲吻",特效师号被封!这算隔空猥亵吗?

2023-03-28
新浪影音娱乐
Why's our monitor labelling this an incident or hazard?
The event explicitly involves the use of AI synthesis technology (face-swapping and video manipulation) to create misleading content that harms the reputation and rights of a person. This constitutes a violation of personal rights and legal protections, which are recognized harms under the AI Incident definition (violations of human rights or breach of applicable law). The AI system's use directly led to these harms, and the platform's response (account suspension) confirms the incident's seriousness. Therefore, this qualifies as an AI Incident.
Thumbnail Image

法治课|特效师深度合成与明星亲密视频,侵犯了哪些权利?_洪某_行为_迪丽热巴

2023-03-28
搜狐新闻
Why's our monitor labelling this an incident or hazard?
The event explicitly involves the use of AI systems for deep synthesis (deepfake) to create videos that replace original actors with another individual, which is a clear AI system involvement. The use of this AI system directly led to harm: infringement of portrait rights, reputation rights, personality rights, and copyright violations, as well as violations of network security laws. The article details the harms caused, legal analyses, and potential criminal consequences, confirming that the AI system's use has directly led to an AI Incident. Therefore, this event qualifies as an AI Incident rather than a hazard or complementary information.
Thumbnail Image

男网红称因合成女明星视频被打,网友:这算不算隔空性骚扰?_洪某_行为_身体

2023-03-27
搜狐新闻
Why's our monitor labelling this an incident or hazard?
The event explicitly involves the use of AI deepfake technology to create synthetic videos without consent, infringing portrait rights, which is a violation of intellectual property and personal rights under law. The resulting physical assault on the influencer by fans is a direct harm to his health. The AI system's use is central to the incident, as the deepfake videos caused the conflict leading to harm. Hence, this is an AI Incident due to realized harm (physical assault) and rights violations caused by AI-generated content.
Thumbnail Image

用AI换脸让自己和迪丽热巴“亲吻” 这位特效师已涉嫌侵权

2023-03-27
华商网
Why's our monitor labelling this an incident or hazard?
The event explicitly involves AI face-swapping technology (an AI system) used to alter copyrighted video content and create misleading depictions of actors, which has led to reputational harm and copyright infringement. The AI system's use directly caused these harms, fulfilling the criteria for an AI Incident under violations of intellectual property rights and harm to individuals' reputations. The dissemination and teaching of these techniques further exacerbate the harm. Hence, the classification as AI Incident is appropriate.