AI-Generated Deepfake Audio Used to Defame Manaus Mayor Triggers Federal Investigation

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

In December 2023, an AI-generated deepfake audio falsely simulating the voice of Manaus mayor David Almeida insulting teachers was widely circulated online. The incident led to reputational harm and misinformation. Brazilian Federal Police launched Operation Nirmata, executing search warrants and seizing equipment from suspects involved in creating and spreading the fake audio.[AI generated]

Why's our monitor labelling this an incident or hazard?

The use of AI to generate defamatory audio that harms a person's reputation and influences an election fits the definition of an AI Incident, as it involves the use of an AI system leading directly to harm (violation of rights and harm to communities through misinformation). The police action confirms the harm has occurred and is being addressed.[AI generated]
AI principles
AccountabilityPrivacy & data governanceRobustness & digital securitySafetyTransparency & explainabilityRespect of human rightsDemocracy & human autonomy
Industries
Media, social platforms, and marketingGovernment, security, and defenceDigital security
Affected stakeholders
GovernmentWorkersGeneral public
Harm types
ReputationalPublic interest
Severity
AI incident
AI system task:
Content generation

Articles about this incident or hazard

Thumbnail Image

PF faz operação contra suspeitos de usarem IA para criar áudio e difamar prefeito de Manaus

2024-02-09
Home
Why's our monitor labelling this an incident or hazard?
The use of AI to generate defamatory audio that harms a person's reputation and influences an election fits the definition of an AI Incident, as it involves the use of an AI system leading directly to harm (violation of rights and harm to communities through misinformation). The police action confirms the harm has occurred and is being addressed.
Thumbnail Image

PF faz operação contra suspeitos de usarem IA para criar áudio e difamar prefeito de Manaus

2024-02-09
Terra
Why's our monitor labelling this an incident or hazard?
The article explicitly states that AI tools were used to generate a deepfake audio falsely portraying the mayor insulting teachers, which circulated on social media and caused harm. This is a clear case where the AI system's use directly led to harm (defamation and misinformation) with legal consequences (investigation and potential charges). Therefore, this qualifies as an AI Incident under the framework, as the AI system's use directly caused harm to individuals and communities through misinformation and defamation.
Thumbnail Image

PF faz operação contra suspeitos de usarem IA para criar áudio e difamar prefeito de Manaus

2024-02-09
ISTOÉ Independente
Why's our monitor labelling this an incident or hazard?
The article explicitly states that AI tools were used to create a deepfake audio that defamed the mayor, which was then spread on social media. This constitutes a direct AI Incident because the AI system's use led to harm (defamation and misinformation) affecting the individual and potentially the community. The investigation and law enforcement action confirm the harm has occurred and is being addressed. Therefore, this is an AI Incident rather than a hazard or complementary information.
Thumbnail Image

PF faz operação contra suspeitos de usarem IA para criar áudio e difamar prefeito de Manaus | Exame

2024-02-09
Exame
Why's our monitor labelling this an incident or hazard?
The article explicitly states that AI tools were used to create a deepfake audio falsely attributed to the mayor, which was circulated to defame him. This use of AI directly led to harm in the form of defamation and misinformation affecting the individual and potentially the electoral process, fitting the definition of an AI Incident. The harm is realized, not just potential, and involves violation of rights and harm to community trust, thus qualifying as an AI Incident rather than a hazard or complementary information.
Thumbnail Image

PF faz operação contra suspeitos de usarem IA para criar áudio e difamar prefeito de Manaus

2024-02-09
Estadão
Why's our monitor labelling this an incident or hazard?
The article explicitly states that AI (deepfake technology) was used to create a fake audio recording that defames the mayor of Manaus, which is a direct harm to the individual's reputation and a violation of electoral laws. The involvement of AI in generating the defamatory content is clear, and the harm has already occurred, as evidenced by the police operation and legal actions. This fits the definition of an AI Incident because the AI system's use directly led to harm (violation of rights and defamation).
Thumbnail Image

PF faz operação contra suspeito de difamar prefeito de Manaus com IA

2024-02-09
Poder360
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of AI (deep fake technology) to create a false audio clip defaming the mayor, which has been disseminated and caused reputational harm. This fits the definition of an AI Incident because the AI system's use directly led to harm (defamation and misinformation). The investigation and seizure of equipment further confirm the realized harm and the AI system's role in it.
Thumbnail Image

PF identifica autores de áudio contra prefeito de Manaus com uso de IA

2024-02-09
Correio
Why's our monitor labelling this an incident or hazard?
An AI system was explicitly used to create a false audio recording that defamed a public official, constituting a violation of rights and harm to the community through misinformation. The event involves the use and misuse of AI-generated content causing realized harm, fitting the definition of an AI Incident.
Thumbnail Image

PF apura crime de difamação eleitoral cometido com uso da inteligência artificial - Jovem Pan

2024-02-09
Jovem Pan – Esportes, entretenimento, notícias e vídeos com credibilidade
Why's our monitor labelling this an incident or hazard?
The article explicitly states that an AI system was used to create a defamatory audio falsely attributed to the mayor, which constitutes a violation of rights and harm to the community through electoral disinformation. The harm has already occurred as the fake audio was circulated, leading to an official investigation and legal actions. Therefore, this qualifies as an AI Incident because the AI system's use directly led to harm (defamation and misinformation) and legal consequences.
Thumbnail Image

PF identifica autores de áudio contra prefeito de Manaus com uso de IA

2024-02-09
Istoe dinheiro
Why's our monitor labelling this an incident or hazard?
The article describes a case where AI was used to create a false audio recording of the mayor, which was disseminated to defame him. This constitutes a direct harm to the individual and the community by spreading misinformation and potentially influencing electoral processes. The AI system's use in producing the fake audio is central to the incident, fulfilling the criteria for an AI Incident due to realized harm (defamation and misinformation).
Thumbnail Image

PF faz operação para apurar uso de inteligência artificial para difamar prefeito de Manaus

2024-02-09
CartaCapital
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of AI to generate a fake audio simulating the mayor's voice, which was used to defame him. This constitutes a violation of rights (reputational harm and electoral defamation) and harm to communities by spreading misinformation. The AI system's use directly led to this harm. Therefore, this qualifies as an AI Incident under the framework, as the AI system's misuse caused realized harm.
Thumbnail Image

Operação da PF mira suspeitos de usar inteligência artificial em montagem de áudio com voz do prefeito de Manaus

2024-02-09
Jornal Floripa - Notícias de Florianópolis - Santa Catarina Brasil
Why's our monitor labelling this an incident or hazard?
The event explicitly involves the use of AI to generate a manipulated audio clip that has been disseminated, causing harm to the mayor's reputation and potentially harming the community by spreading false information. This constitutes a violation of rights and harm to community trust, fitting the definition of an AI Incident. The investigation and law enforcement response confirm the harm has occurred and is being addressed.
Thumbnail Image

PF faz operação para apurar crime de difamação eleitoral cometido por meio de inteligência artificial

2024-02-09
Governo do Brasil
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of artificial intelligence to create a false audio message that defamed the mayor of Manaus, which is a violation of legal and electoral rights. The AI system's use directly led to harm in the form of misinformation and reputational damage, fulfilling the criteria for an AI Incident. The investigation and legal response further confirm the materialized harm caused by the AI system's misuse.
Thumbnail Image

PF mira suspeitos de usar inteligência artificial para difamar prefeito de Manaus

2024-02-09
CNN Brasil
Why's our monitor labelling this an incident or hazard?
The article explicitly states that an AI system was used to generate a false audio clip that defamed the mayor, which was disseminated widely and caused harm by spreading misinformation. This constitutes a violation of rights and harm to the community through misinformation and defamation. Since the harm has already occurred and the AI system's use was pivotal in creating the false content, this qualifies as an AI Incident under the framework.