AI-Generated Deepfake Video Misrepresents Italian President in Political Campaign

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Roberto Vannacci, leader of Futuro Nazionale, published an AI-generated deepfake video on Instagram depicting President Sergio Mattarella granting a pardon to Mario Roggero. The video, used to promote a petition, violates a political pact against AI-generated misinformation and risks misleading the public and eroding trust in political institutions.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves the use of AI systems to generate deepfake videos, which are explicitly mentioned. The videos have been posted publicly and are intended to influence political opinion, which can harm communities by spreading false information and undermining democratic processes. This meets the criteria for an AI Incident as the AI system's use has directly led to harm to communities through misinformation and political manipulation. The event is not merely a potential risk but an actual occurrence of harm caused by AI-generated content.[AI generated]
AI principles
Transparency & explainabilityDemocracy & human autonomy

Industries
Media, social platforms, and marketing

Affected stakeholders
General publicGovernment

Harm types
ReputationalPublic interest

AI system task:
Content generation


Articles about this incident or hazard