AI Deepfake Ads Use Celebrity Faces in Sexualized Content on Social Media

The event explicitly mentions the use of a deepfake AI system to manipulate videos by swapping faces onto sexually suggestive content without consent. This directly leads to harm in terms of violation of personal rights and potential psychological and reputational damage to the individuals involved. Therefore, it qualifies as an AI Incident under the category of violations of human rights or breach of obligations intended to protect fundamental rights.

The event clearly involves an AI system (deepfake technology) used to generate manipulated sexual content featuring real individuals' faces without consent. This has directly led to harm in terms of potential violation of privacy, reputational damage, and emotional distress to the individuals depicted, as well as broader societal harm through the spread of non-consensual explicit content. The removal of ads and app from platforms confirms the recognition of harm. Therefore, this qualifies as an AI Incident due to the realized harm caused by the AI system's use.

The event explicitly involves AI-generated deepfake videos, which are created using AI systems that manipulate facial images to produce realistic but fake content. The use of these deepfakes in sexual ads without consent directly harms the individuals depicted by violating their privacy and potentially their rights. The harm is realized as the ads were widely circulated and viewed millions of times, causing reputational and emotional harm. The platforms' removal actions are responses to an ongoing AI Incident rather than preventive measures. Hence, this is an AI Incident due to realized harm caused by the AI system's use.

The event explicitly involves AI systems (deepfake face-swapping technology) used to create sexualized videos without consent, which is a direct violation of human rights and causes harm to individuals and communities. The widespread advertising and availability of such AI-generated content on major platforms like Facebook and Instagram demonstrate realized harm, not just potential harm. Therefore, this qualifies as an AI Incident under the definitions provided, as the AI system's use has directly led to violations of rights and harm.

The event describes the use of an AI deepfake app to create and distribute sexually explicit videos featuring the faces of real people without consent, which is a direct violation of their rights and causes harm to their reputation and privacy. The AI system's use directly led to the dissemination of harmful content, fulfilling the criteria for an AI Incident under violations of human rights and harm to communities. The involvement of AI in generating the deepfakes and the resulting harm is explicit and central to the event. Therefore, this qualifies as an AI Incident.

The use of deepfake AI technology to create and distribute non-consensual sexually explicit images constitutes a violation of personal rights and can be considered harm to individuals. The AI system's use directly led to this harm by generating and enabling the spread of manipulated content. Therefore, this event qualifies as an AI Incident under the definition of causing violations of human rights or breach of obligations intended to protect fundamental rights.

The event explicitly involves an AI system (deep learning algorithms for face swapping) used to create harmful deepfake pornographic videos without consent, leading to violations of privacy and bodily autonomy, psychological harm, and reputational damage. The AI system's use directly led to these harms, fulfilling the criteria for an AI Incident. The widespread dissemination on social media platforms further amplifies the harm. Meta's policy enforcement is a response but does not change the classification of the event as an incident.

The event explicitly involves AI systems generating deepfake videos, which are used without consent to create sexually explicit content. This directly leads to harm in the form of violations of individuals' rights and potential emotional and reputational damage. The AI system's use in creating and distributing this content is central to the harm. Therefore, this is an AI Incident due to realized harm caused by AI misuse.

The app Facemega uses AI-based face-swapping technology to generate deepfake pornographic content without consent, which constitutes a violation of human rights and privacy. The article documents that this harm is occurring, not just a potential risk, as the app was actively advertising and enabling the creation of such content. This meets the criteria for an AI Incident because the AI system's use has directly led to harm (violation of rights and harm to communities). The event is not merely a hazard or complementary information, as the harm is realized and ongoing.

The event clearly involves an AI system (deepfake face swap technology) used to create non-consensual sexually explicit videos, which constitutes a violation of human rights and causes harm to individuals (harm to persons and communities). The widespread dissemination of these videos and ads on Facebook and Instagram directly led to harm, including reputational damage and psychological trauma. Therefore, this qualifies as an AI Incident under the framework, as the AI system's use directly led to harm. The removal of the app is a response but does not negate the incident itself.

The event involves AI systems explicitly (deepfake technology) used to create altered sexualized images without consent, which constitutes a violation of personal rights and causes harm to individuals and communities. The article details actual harm occurring (distribution of deepfake porn), thus qualifying as an AI Incident under violations of human rights and harm to communities. The involvement of AI in the malicious use and the resulting harm is direct and clear.

The event involves an AI system (deepfake face-swapping technology) used maliciously to create sexually suggestive videos without consent, which is a violation of rights and causes harm to the victims. The harm is realized, as the content was widely advertised and distributed, leading to harassment, discrimination, and potential personal and professional consequences for the victims. The app's availability and advertising facilitated this harm. Therefore, this qualifies as an AI Incident under the definitions provided, specifically under violations of human rights and harm to communities.

The event explicitly involves an AI system—deepfake face-swapping technology—that has been used to create sexually suggestive videos featuring the faces of celebrities without consent. This constitutes a violation of personal rights and can cause harm to individuals' reputations and mental health, fulfilling the criteria for harm to persons and communities. The ads were actively running on major social media platforms, indicating realized harm rather than just potential. The use of AI in generating nonconsensual sexual content is a direct cause of the harm described. Therefore, this qualifies as an AI Incident.

The event involves AI systems explicitly (deepfake AI generating fake videos). The use of these AI-generated videos in ads caused harm by violating the rights and dignity of the individuals depicted, which is a breach of fundamental rights. The harm is realized as the videos were widely viewed and caused reputational damage. The removal of the ads and app is a response but does not negate the incident. Hence, this is an AI Incident as the AI system's use directly led to harm.

The event explicitly involves an AI system (deepfake face-swapping app) used to create sexualized fake videos of celebrities, which were then advertised on major social media platforms. This use of AI directly led to harm in the form of violations of personal and intellectual property rights, as well as reputational harm to the individuals depicted. The ads' presence on Facebook and Instagram indicates a failure in content moderation related to AI-generated harmful content. The harm is realized and ongoing until the ads were removed, fitting the definition of an AI Incident under violations of rights and harm to communities. Thus, the classification as AI Incident is appropriate.

The event involves the use of an AI system (FaceMega) to generate deepfake videos, which directly leads to harm by violating the rights and dignity of the individuals depicted (Emma Watson and Scarlett Johansson). The content is sexually explicit and non-consensual, which can cause reputational and psychological harm, fitting the definition of an AI Incident under violations of human rights and harm to communities. The harm is realized as the videos have been published and proliferated on major social media platforms.

The event explicitly involves AI systems used to generate deepfake videos, which are AI-generated synthetic media. The use of these deepfakes in sexual content without consent directly violates the rights of the individuals involved, constituting harm under the category of violations of human rights and breach of legal protections. The harm is occurring as the videos are actively distributed and viewed, fulfilling the criteria for an AI Incident. Therefore, this event is classified as an AI Incident due to realized harm caused by AI-generated non-consensual deepfake content.

The event explicitly involves an AI system (FaceMega) that generates deepfake videos, which are AI-generated synthetic media. The use of this AI system has directly led to the creation and dissemination of non-consensual sexual content, violating the rights and privacy of the individuals depicted (Emma Watson, Scarlett Johansson). This constitutes a violation of human rights and harm to communities. The harm is realized, not just potential, as the videos were publicly distributed and caused alarm. Therefore, this qualifies as an AI Incident under the framework.

The event involves an AI system (FaceMega) that uses machine learning and AI for face swapping in videos, creating realistic deepfake content. The use of this AI system directly caused harm by producing and disseminating non-consensual sexual deepfake videos, violating personal rights and causing reputational and emotional damage. This fits the definition of an AI Incident because the AI system's use has directly led to violations of human rights and harm to communities. The removal of the app and restrictions on social media are responses to the incident but do not change the classification.

The event explicitly involves AI-generated deepfake videos, which are created by AI systems manipulating facial images and videos. The use of these deepfakes in sexualized false advertisements directly harms the individuals depicted (violation of rights and reputational harm) and potentially harms communities by spreading deceptive and offensive content. The platforms' removal of the content confirms the harm was recognized and materialized. Hence, this is an AI Incident as the AI system's use directly led to harm.

The event involves an AI system (deepfake face-swapping app) used to create manipulated videos with celebrity faces, which constitutes a violation of rights and harm to individuals' reputations. The deployment of these deepfakes in a mass advertising campaign on social media platforms directly led to harm, fulfilling the criteria for an AI Incident under violations of human rights and harm to communities. The removal of ads after reporting does not negate the occurrence of harm.

The FaceMega app uses AI-based deepfake technology to generate realistic pornographic videos without consent, directly causing harm to the individuals depicted and potentially to broader communities through the spread of such content. The article explicitly states the creation and distribution of these videos, confirming realized harm. The AI system's use is central to the incident, fulfilling the criteria for an AI Incident under violations of rights and harm to communities. The presence of the AI system is explicit, the harm is realized, and the event is not merely a potential risk or complementary information.

The app DeepFake FaceSwap is an AI system that generates manipulated video content by replacing faces, a clear AI application. Its use in creating non-consensual sexualized deepfake videos constitutes a violation of individual rights and causes harm to the affected persons and communities. The event reports actual use and dissemination of such content, not just potential risk, thus qualifying as an AI Incident. The harm includes violation of rights and reputational damage, fitting the definition of harm to communities and breach of fundamental rights. Therefore, this is classified as an AI Incident.

The event explicitly involves an AI system (deepfake face-swapping technology) used to create manipulated videos with swapped faces, which were distributed widely on social media. The harm includes non-consensual sexualized content, which violates personal rights and can cause reputational and psychological harm to the individuals depicted, as well as potential harm to communities through the spread of manipulative content. The AI system's use directly led to these harms, fulfilling the criteria for an AI Incident under violations of rights and harm to communities.