AI-Generated Deepfake Influencers Promote Far-Right Politics on TikTok

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

AI-generated deepfake profiles resembling relatives of French far-right politicians Marine Le Pen and Marion Maréchal have amassed large followings on TikTok. These fictitious influencers spread sexualized images and political messages supporting the Rassemblement National, misleading users and manipulating public opinion, raising concerns about AI-driven misinformation in democratic processes.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event explicitly involves AI systems generating deepfake videos that impersonate political figures to spread misleading political content. The use of AI-generated deepfakes in this context directly leads to harm to communities by spreading misinformation and manipulating political opinions, which can disrupt democratic processes and violate rights related to truthful information and fair political participation. The harm is occurring as the videos have been widely viewed and are influencing public discourse. Hence, this is an AI Incident rather than a hazard or complementary information.[AI generated]
AI principles
AccountabilityPrivacy & data governanceRespect of human rightsRobustness & digital securitySafetyTransparency & explainabilityDemocracy & human autonomyHuman wellbeing

Industries
Media, social platforms, and marketingGovernment, security, and defence

Affected stakeholders
General public

Harm types
ReputationalPsychologicalPublic interestHuman or fundamental rights

Severity
AI incident

Business function:
Marketing and advertisement

AI system task:
Content generationOrganisation/recommenders

In other databases

Articles about this incident or hazard

Thumbnail Image

Sur TikTok, ces fausses influenceuses font la pub du Rassemblement national pour les européennes

2024-04-13
Yahoo actualités
Why's our monitor labelling this an incident or hazard?
The event explicitly involves AI systems generating deepfake videos that impersonate political figures to spread misleading political content. The use of AI-generated deepfakes in this context directly leads to harm to communities by spreading misinformation and manipulating political opinions, which can disrupt democratic processes and violate rights related to truthful information and fair political participation. The harm is occurring as the videos have been widely viewed and are influencing public discourse. Hence, this is an AI Incident rather than a hazard or complementary information.
Thumbnail Image

Amandine Le Pen, Léna Maréchal... ces faux comptes sur TikTok qui promeuvent l'extrême droite

2024-04-13
Yahoo actualités
Why's our monitor labelling this an incident or hazard?
The article describes the creation and use of AI-generated fake profiles on TikTok that impersonate real political figures and promote extremist political content. This involves AI systems generating realistic faces and content, leading to misinformation and manipulation risks. The harm to communities through misinformation and political manipulation is materialized, making this an AI Incident rather than a hazard or complementary information. The AI system's use directly leads to harm by spreading misleading political content and potentially influencing elections.
Thumbnail Image

Élections européennes : des faux comptes utilisent l'intelligence artificielle pour inciter à voter extrême droite : Actualités - Orange

2024-04-13
Orange Actualités
Why's our monitor labelling this an incident or hazard?
The event involves AI systems explicitly (deepfake technology) used to create misleading videos that influence political opinions and voter behavior. The harm is realized as these videos have millions of views and are actively used to sway electoral outcomes, which can disrupt democratic rights and harm communities. Therefore, this qualifies as an AI Incident due to the direct use of AI-generated content causing harm to communities and potentially violating rights related to fair political processes.
Thumbnail Image

Européennes : "Amandine Le Pen", "Léna Maréchal"... Ces faux comptes TikTok, basés sur l'IA, qui promeuvent la droite nationaliste

2024-04-12
Le Figaro.fr
Why's our monitor labelling this an incident or hazard?
The article explicitly describes AI-generated fake profiles using deepfake technology to create misleading videos of political figures, which are actively promoting political agendas. This use of AI directly leads to harm by spreading misinformation and potentially manipulating voters, which harms communities and violates democratic rights. The harm is realized as these videos have millions of views and influence public perception. Hence, it meets the criteria for an AI Incident rather than a hazard or complementary information.
Thumbnail Image

Faux comptes de la famille Le Pen sur TikTok : Jordan Bardella appelle à une " régulation "

2024-04-13
Ouest France
Why's our monitor labelling this an incident or hazard?
The event involves AI systems in the form of deepfake technology used to create false social media profiles. Although no direct harm has occurred yet, the potential for these deepfakes to disrupt elections and democracy is a plausible future harm. Therefore, this situation qualifies as an AI Hazard because it highlights a credible risk stemming from the use of AI-generated content that could lead to significant societal harm if unregulated.
Thumbnail Image

Bardella appelle à la " régulation " des faux comptes sur les réseaux sociaux

2024-04-14
20minutes
Why's our monitor labelling this an incident or hazard?
The event involves AI-generated deepfake accounts that are actively influencing political discourse and spreading misinformation, which is a violation of rights and harms communities by undermining democratic processes. Although the article does not describe a specific realized harm or incident, the ongoing use of these AI systems for malicious purposes and the call for regulation indicate a credible and plausible risk of harm. Therefore, this qualifies as an AI Hazard, as the AI system's use could plausibly lead to significant harm to democracy and society if unregulated.
Thumbnail Image

Qui sont Amandine Le Pen et Léna Maréchal, ces deepfakes qui font la promotion de l'extrême droite sur TikTok ?

2024-04-13
Le Parisien
Why's our monitor labelling this an incident or hazard?
The event involves AI systems generating deepfake videos, which are used to promote political propaganda. The use of AI-generated deepfakes to mislead viewers and influence political opinions constitutes harm to communities, as it can distort information and manipulate public discourse. Since the deepfakes are actively used and have reached a significant audience, this is a realized harm rather than a potential one, qualifying it as an AI Incident under the framework.
Thumbnail Image

Marine Le Pen, Marion Maréchal... Mais qui sont ces fakes d'extrême droite ? Regardez le nouveau numéro de "C quoi l'info ?"

2024-04-12
Franceinfo
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of AI to create deepfake videos of fake political personas that are actively disseminated on social media to influence voting behavior. This constitutes a direct use of AI systems leading to potential harm to communities by undermining electoral integrity and informed decision-making. Since the harm is plausible and imminent (two months before elections) but not explicitly stated as having already caused harm, this qualifies as an AI Hazard rather than an AI Incident.
Thumbnail Image

Européennes: ces faux comptes Tiktok utilisant les visages de Marine Le Pen et Marion Maréchal promeuvent le RN et Reconquête

2024-04-12
BFMTV
Why's our monitor labelling this an incident or hazard?
The use of AI and deepfake technology to create fake accounts and videos that promote extremist political content constitutes a direct harm to communities by spreading misinformation and potentially manipulating democratic processes. The AI system's use in generating these deepfakes is central to the harm, making this an AI Incident under the category of harm to communities.
Thumbnail Image

Européennes: "Amandine Le Pen", "Lena Maréchal"... sur Tiktok, ces comptes entendent pousser l'extrême droite

2024-04-12
BFMTV
Why's our monitor labelling this an incident or hazard?
The event explicitly involves AI systems through the use of deepfake technology, which is an AI method for digitally altering faces in videos. The use of these AI-generated deepfakes to impersonate political figures and spread political messages on social media platforms has directly led to harm by misleading the public and potentially influencing elections, which constitutes harm to communities. The article describes the harm as ongoing, with millions of views and active political messaging. This meets the criteria for an AI Incident because the AI system's use has directly led to significant harm to communities through misinformation and political manipulation.
Thumbnail Image

"Amandine Le Pen" et "Léna Maréchal" : qui sont ces influenceuses générées par l'IA qui font la promotion de l'extrême droite sur TikTok ?

2024-04-14
Ladepeche.fr
Why's our monitor labelling this an incident or hazard?
The event involves AI systems explicitly through the use of deepfake technology to generate realistic fake influencer accounts. These AI-generated videos are actively promoting extremist political content, misleading users, and influencing public opinion, which constitutes harm to communities and a violation of rights related to truthful information. Since the harm is ongoing and directly linked to the AI-generated content, this qualifies as an AI Incident rather than a hazard or complementary information.
Thumbnail Image

Réseaux sociaux. Amandine Le Pen, la fausse nièce de Marine générée par une IA

2024-04-12
Courrier international
Why's our monitor labelling this an incident or hazard?
The event involves AI systems generating deepfake videos of fictitious political personas, which are used to spread misleading content on social media. The harm is realized as these profiles have millions of views and tens of thousands of followers, influencing public discourse and potentially affecting democratic processes. The AI system's role is pivotal in creating realistic fake personas that deceive viewers. Therefore, this qualifies as an AI Incident due to the direct harm caused by misinformation and manipulation of political information.
Thumbnail Image

Amandine Le Pen : le deepfake créé pour soutenir l'extrême droite française sur TikTok

2024-04-12
RTBF
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems (generative AI and deepfake technology) to create fake political personas that are actively used on social media platforms. This use directly leads to harm to communities by spreading misleading political content and potentially influencing public opinion under false pretenses. Therefore, it meets the criteria of an AI Incident due to realized harm from AI-generated misinformation and manipulation in the political domain.
Thumbnail Image

Chloé et Amandine Le Pen n'existent pas, mais sur TikTok elles assurent la promo du RN

2024-04-12
Le Huffington Post
Why's our monitor labelling this an incident or hazard?
The event involves AI systems generating deepfake videos (AI System involvement). The use of these AI-generated personas to promote political propaganda constitutes the use of AI leading to harm to communities through misinformation and manipulation, which is a recognized form of harm under the framework. The harm is realized as these videos have significant views and influence, thus qualifying as an AI Incident rather than a mere hazard or complementary information.
Thumbnail Image

Comment de fausses nièces de Marine Le Pen encensent le RN sur TikTok

2024-04-13
Le Huffington Post
Why's our monitor labelling this an incident or hazard?
The event involves AI systems explicitly, as it discusses deepfake videos generated by AI tools. The use of these AI-generated fake personas to promote political propaganda constitutes a misuse of AI technology that directly harms communities by spreading misinformation and potentially influencing elections, which is a harm to communities and democratic rights. Therefore, this qualifies as an AI Incident because the AI system's use has directly led to significant harm through misinformation and political manipulation.
Thumbnail Image

Amandine Le Pen, Léna Maréchal... ces faux comptes sur TikTok qui promeuvent l'extrême droite

2024-04-13
Le Point.fr
Why's our monitor labelling this an incident or hazard?
The article explicitly states that AI was used to generate fake profiles with faces and names of political figures, which are then used to promote extremist political content. This constitutes a direct use of AI systems leading to harm to communities through misinformation and manipulation. The harm is realized as these accounts have amassed large followings and views, spreading misleading content. Therefore, this qualifies as an AI Incident under the framework, as the AI system's use has directly led to harm to communities by spreading false political information and impersonation.
Thumbnail Image

Amandine Le Pen, Lena Maréchal : sur TikTok, des " deepfakes " créés par IA, Bardella appelle à une " régulation "

2024-04-14
SudOuest.fr
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI-generated deepfakes used to impersonate political figures and spread misleading, nationalist, and racist content on social media. These deepfakes are actively influencing public opinion and elections, which is a clear harm to communities and democratic processes. The AI system's use directly leads to this harm. The presence of actual harm (misinformation affecting elections) and the AI system's pivotal role in creating the deepfakes qualifies this as an AI Incident rather than a hazard or complementary information.
Thumbnail Image

Amandine Le Pen, une effigie TikTok au service de l'extrême droite

2024-04-12
DH.be
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI-generated deepfake videos used to impersonate political figures and promote political messages, which can mislead and manipulate public opinion. This use of AI directly leads to harm in the form of misinformation and potential violation of personality rights. The harm is realized as the videos have been widely viewed and shared, influencing public discourse. Therefore, this event meets the criteria for an AI Incident due to the direct involvement of AI in causing harm to communities and rights violations.
Thumbnail Image

Qui est Amandine Le Pen, ce deepfake au service de l'extrême droite?

2024-04-11
rts.ch
Why's our monitor labelling this an incident or hazard?
The event involves AI systems explicitly through the use of deepfake technology (AI-generated synthetic media). The use of these AI systems has directly led to the dissemination of false and misleading political content, which harms communities by spreading misinformation and potentially influencing elections. This fits the definition of an AI Incident as it involves violations of rights and harm to communities caused by the AI system's use. The article also discusses the legal implications and societal risks, confirming the realized harm rather than just potential harm.
Thumbnail Image

Amandine Le Pen, Lena Maréchal... des faux comptes générés par l'IA qui font la promotion de l'extrême droite

2024-04-13
midilibre.fr
Why's our monitor labelling this an incident or hazard?
The event involves AI systems generating deepfake videos and fake social media profiles that impersonate real individuals to promote political agendas. This use of AI directly leads to misinformation and manipulation, harming communities by spreading false political content and potentially influencing elections. The harm is realized as these accounts have thousands of followers and actively promote political parties under false pretenses. Therefore, this qualifies as an AI Incident due to the direct harm caused by AI-generated misinformation and impersonation.
Thumbnail Image

Amandine Le Pen, Léna Maréchal... Comment des comptes anonymes font la promotion de l'extrême droite sur TikTok grâce à l'intelligence artificielle

2024-04-13
lindependant.fr
Why's our monitor labelling this an incident or hazard?
The event explicitly involves AI systems (deepfake generation) used to create synthetic videos promoting extremist political content. The use of these AI-generated deepfakes to influence voters and spread misleading political messages during an election is a direct harm to communities and democratic processes. The harm is realized as these videos have millions of views and can mislead many users, especially young people on TikTok. Therefore, this qualifies as an AI Incident due to the direct link between AI use and harm to communities and political rights.
Thumbnail Image

" Amandine Le Pen ", " Léna Maréchal "... ces deepfakes pour promouvoir l'extrême droite cartonnent sur TikTok

2024-04-13
La Voix du Nord
Why's our monitor labelling this an incident or hazard?
The event involves AI systems explicitly through the use of deepfake technology, which is an AI system that generates synthetic video and audio content. The use of these deepfakes has directly led to harm by misleading users and spreading disinformation, which harms communities and the democratic process. Therefore, this qualifies as an AI Incident because the AI system's use has directly caused harm through misinformation and manipulation of public opinion.
Thumbnail Image

Amandine Le Pen, l'influenceuse d'extrême droite qui n'existe pas

2024-04-12
Numerama.com
Why's our monitor labelling this an incident or hazard?
The event explicitly describes the creation and dissemination of deepfake videos generated by AI, which impersonate non-existent individuals related to a political family to spread extremist political content. This use of AI directly causes harm by misleading the public, spreading false information, and potentially influencing democratic processes, which constitutes harm to communities. The harm is realized as the videos have already been widely viewed and interacted with, fulfilling the criteria for an AI Incident rather than a mere hazard or complementary information.
Thumbnail Image

Intelligence artificielle et extrême droite: les inquiétantes "créations" de l'IA

2024-04-14
Sudinfo.be
Why's our monitor labelling this an incident or hazard?
The event involves AI systems explicitly used to create deepfake personas that spread political propaganda and misinformation, which is a direct harm to communities by manipulating democratic processes and public discourse. The AI-generated content has been actively used and viewed by many, fulfilling the criteria for an AI Incident due to realized harm. The political parties' denial of involvement and the Prime Minister's security concerns further underscore the seriousness of the harm caused by AI misuse in this context.
Thumbnail Image

Elle attire les jeunes vers l'extrême droite: qui est Amandine, cette fausse nièce de Marine Le Pen qui cartonne sur Tik Tok?

2024-04-13
RTL Info
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems to create a fictitious influencer persona that is actively promoting extremist political views, which can harm communities by spreading misinformation and extremist content. This constitutes harm to communities and a violation of rights through manipulation and misinformation. Since the AI system's use has directly led to this harm, it qualifies as an AI Incident.
Thumbnail Image

Marine Le Pen et Marion Maréchal débarquent en version sexy sur TikTok grâce à l'Intelligence artificielle

2024-04-14
Journal L'Union
Why's our monitor labelling this an incident or hazard?
The event describes AI-generated deepfake videos that misrepresent political figures, which constitutes a violation of rights related to misinformation and reputational harm. The AI system's use directly leads to this harm by creating realistic fake content. The presence of warnings and potential legal actions does not negate the occurrence of harm. Therefore, this is an AI Incident due to the realized harm caused by the AI system's outputs affecting communities and individuals' rights.
Thumbnail Image

Lena Maréchal, Amandine Le Pen : des deep fakes qui partagent des slogans du Rassemblement national ont été créés sur TikTok, Jordan Bardella plaide pour une " régulation "

2024-04-14
Atlantico
Why's our monitor labelling this an incident or hazard?
The event involves AI systems explicitly (deep fake generation) used to create false profiles that spread misleading political messages. This use directly harms the democratic process and community trust, fitting the definition of harm to communities. The harm is realized, not just potential, as the fake profiles have been active and followed by many users. The political party affected calls for regulation, indicating recognized harm. Hence, this is an AI Incident rather than a hazard or complementary information.
Thumbnail Image

"Une expérience sociale" : le créateur du faux compte de Léna Maréchal sort du silence après la suppression des profils

2024-04-15
midilibre.fr
Why's our monitor labelling this an incident or hazard?
The use of AI-generated deepfake accounts to spread political messages constitutes a violation of rights and can cause harm to communities by misleading voters and interfering with democratic processes. The accounts were active and had thousands of followers, indicating realized harm through misinformation and potential manipulation of electoral outcomes. Therefore, this qualifies as an AI Incident due to the direct harm caused by the AI system's use in spreading false political endorsements and influencing elections.
Thumbnail Image

Qui sont Amandine Le Pen et Léna Maréchal sur TikTok ?

2024-04-15
RTL.fr
Why's our monitor labelling this an incident or hazard?
The event involves AI systems creating deepfake content that impersonates real political figures, which is a direct use of AI-generated synthetic media. The harm arises from the misleading and deceptive nature of these deepfakes, which can influence voters and disrupt democratic processes, thus causing harm to communities and potentially violating rights related to truthful information and fair political participation. Since the harm is occurring through the dissemination of these AI-generated deepfakes, this qualifies as an AI Incident.
Thumbnail Image

Un monde de tech - Les "nièces virtuelles" de Marine Le Pen sur TikTok ont été supprimés

2024-04-16
RFI
Why's our monitor labelling this an incident or hazard?
The event involves AI systems generating hyper-realistic deepfake videos used to spread political misinformation and propaganda, which directly harms communities by undermining democratic processes and spreading false information. The AI-generated content was widely disseminated and had a significant impact, fulfilling the criteria for an AI Incident due to realized harm. The removal of the content and calls for regulation further support the classification as an incident rather than a mere hazard or complementary information.
Thumbnail Image

Européennes 2024 : les nièces Le Pen stars de Tik Tok, une fake news expliquée

2024-04-16
L'internaute
Why's our monitor labelling this an incident or hazard?
The event describes AI-generated deepfake videos that impersonated real political figures and spread extremist political content, which is a clear case of AI misuse leading to harm. The harm here is the dissemination of misinformation and manipulation of public opinion, which affects communities and political processes. The AI system's role in generating these deepfakes is pivotal to the incident. Therefore, this qualifies as an AI Incident due to realized harm caused by the AI system's outputs.
Thumbnail Image

Européennes 2024 : faut-il s'inquiéter des deepfakes ?

2024-04-15
CNEWS
Why's our monitor labelling this an incident or hazard?
The article clearly involves AI systems, specifically deepfake technology that uses AI algorithms to generate realistic fake videos and profiles. The use of these AI-generated deepfakes to impersonate political figures and promote extremist political content constitutes a plausible risk of harm to communities and democratic processes, which aligns with potential harm to communities under the AI Incident definition. However, since the article does not describe any actual harm or incident that has already occurred but rather warns about the emerging threat and potential future harm, this fits the definition of an AI Hazard rather than an AI Incident. The article does not focus on responses or updates, so it is not Complementary Information, and it is clearly related to AI, so not Unrelated.
Thumbnail Image

Les deepfakes des Le Pen rappellent que la modération de contenus est encore insuffisante à l'approche des élections

2024-04-18
EURACTIV France
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems to create deepfake videos, which are AI-generated synthetic media. The use of these deepfakes has directly led to harm by spreading misinformation and potentially influencing electoral outcomes, which harms communities and political processes. The viral nature and millions of views indicate the harm is realized, not just potential. The article also discusses the failure of content moderation and regulatory frameworks to adequately address this harm, reinforcing the classification as an AI Incident. The involvement of AI in generating the deepfakes and the resulting misinformation and reputational damage meet the criteria for an AI Incident under the OECD framework.
Thumbnail Image

TikTok : quand des deepfakes de Marion Maréchal et Marine Le Pen font la promotion de l'extrême droite

2024-04-15
CharenteLibre.fr
Why's our monitor labelling this an incident or hazard?
The videos are explicitly described as generated by AI (deepfakes), which qualifies as an AI system. Their use has directly caused harm by spreading misleading political content that can influence public perception and discourse, constituting harm to communities. The removal of the videos and calls for regulation further indicate recognition of the harm caused. Therefore, this event meets the criteria for an AI Incident due to realized harm linked to AI-generated content.
Thumbnail Image

Est ce que cette "supposée" nièce de Marion Maréchal qui fait le buzz sur TikTok existe vraiment ?

2024-04-15
VL Média
Why's our monitor labelling this an incident or hazard?
The event involves AI systems used to create deepfake videos impersonating political figures, which are then used to promote political parties. This constitutes a violation of rights (image rights and consent) and causes harm to communities by spreading misleading political content. Since the deepfakes are actively used and have millions of views, the harm is realized, not just potential. Therefore, this qualifies as an AI Incident due to the direct harm caused by AI-generated misinformation and identity manipulation in a political context.