AI-Generated Deepfake Audio Targets Manaus Mayor in Election Defamation Case

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Brazilian Federal Police are investigating the use of AI to create a manipulated audio clip falsely attributed to Manaus mayor David Almeida, containing insults to teachers. The deepfake audio circulated on social media, prompting a criminal inquiry for electoral defamation and raising concerns about AI-driven misinformation in upcoming elections.[AI generated]

Why's our monitor labelling this an incident or hazard?

An AI system was used to manipulate the mayor's voice to produce defamatory content, which is a direct misuse of AI technology causing harm to the individual's reputation and potentially affecting electoral processes. The harm is realized as the manipulated audio is circulating on social media, thus meeting the criteria for an AI Incident due to violation of rights and harm to community trust during elections.[AI generated]
AI principles
AccountabilityPrivacy & data governanceTransparency & explainabilityRobustness & digital securitySafetyDemocracy & human autonomyRespect of human rights
Industries
Media, social platforms, and marketingGovernment, security, and defenceEducation and trainingDigital security
Affected stakeholders
Government
Harm types
ReputationalPsychologicalPublic interestHuman or fundamental rights
Severity
AI incident
AI system task:
Content generation

Articles about this incident or hazard

Thumbnail Image

PF investiga em Manaus difamação eleitoral por inteligência artificial

2023-12-22
Estadão
Why's our monitor labelling this an incident or hazard?
An AI system was used to manipulate the mayor's voice to produce defamatory content, which is a direct misuse of AI technology causing harm to the individual's reputation and potentially affecting electoral processes. The harm is realized as the manipulated audio is circulating on social media, thus meeting the criteria for an AI Incident due to violation of rights and harm to community trust during elections.
Thumbnail Image

PF investiga uso de inteligência artificial em montagem de áudio com voz do prefeito de Manaus

2023-12-22
Correio
Why's our monitor labelling this an incident or hazard?
An AI system was used to generate a manipulated audio clip falsely attributed to the mayor, which is a direct misuse of AI leading to reputational harm and potential violation of legal rights. This constitutes an AI Incident because the AI's use directly caused harm through defamation and misinformation.
Thumbnail Image

PF instaura inquérito para investigar uso de IA em difamação contra prefeito de Manaus

2023-12-22
Valor Econômico
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of AI to manipulate audio to defame a political figure, which has already occurred and caused harm through misinformation and defamation. This fits the definition of an AI Incident because the AI system's use directly led to harm (violation of rights and harm to community trust in elections). The investigation and concern by authorities further confirm the seriousness of the harm caused. Therefore, this is classified as an AI Incident.
Thumbnail Image

PF investiga em Manaus difamação eleitoral por inteligência artificial

2023-12-22
Bem Paraná
Why's our monitor labelling this an incident or hazard?
The article explicitly states that the Police Federal is investigating a case where AI was used to manipulate an audio recording to produce defamatory content against a political figure. This use of AI directly led to harm in the form of defamation and misinformation during an electoral context, which is a violation of rights and can influence democratic processes. Therefore, this event meets the criteria for an AI Incident due to realized harm caused by AI-generated content.
Thumbnail Image

PF investiga caso de difamação eleitoral produzido por meio de inteligência artificial no Amazonas

2023-12-22
Governo do Brasil
Why's our monitor labelling this an incident or hazard?
An AI system was used to manipulate audio to produce defamatory content targeting a political figure, which constitutes a violation of rights and harm to communities through misinformation and electoral interference. The harm is realized as the manipulated audio circulated on social media, prompting a police investigation. Therefore, this qualifies as an AI Incident due to the direct involvement of AI in causing harm through defamation and misinformation in an electoral context.