AI-Generated Deepfake Audio Impersonates German News Anchors to Spread Disinformation

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

AI-generated deepfake audio files imitating 'Tagesschau' news anchors circulated online and at public events, falsely claiming the program spread lies about the Ukraine war, COVID-19, and protests. The fakes, using authentic jingles and voices, aimed to erode public trust and damage Germany’s democratic order through targeted disinformation.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves AI systems generating audio content that falsely represents a reputable news source, leading to the dissemination of misinformation. This misinformation harms communities by undermining trust in public information and spreading false narratives about significant topics like the pandemic and war. Since the AI-generated content is actively being spread and causing harm, this qualifies as an AI Incident due to realized harm to communities through disinformation.[AI generated]
AI principles
Transparency & explainabilityDemocracy & human autonomyRespect of human rightsPrivacy & data governanceRobustness & digital securityAccountabilitySafetyHuman wellbeing

Industries
Media, social platforms, and marketingDigital securityGovernment, security, and defence

Affected stakeholders
General public

Harm types
ReputationalPublic interestPsychologicalHuman or fundamental rights

Severity
AI incident

AI system task:
Content generation


Articles about this incident or hazard

Thumbnail Image

Tagesschau warnt Zuschauende aus aktuellem Anlass

2023-11-14
Express.de
Why's our monitor labelling this an incident or hazard?
The event involves AI systems generating audio content that falsely represents a reputable news source, leading to the dissemination of misinformation. This misinformation harms communities by undermining trust in public information and spreading false narratives about significant topics like the pandemic and war. Since the AI-generated content is actively being spread and causing harm, this qualifies as an AI Incident due to realized harm to communities through disinformation.
Thumbnail Image

KI-generierte Beiträge: Tagesschau warnt vor gefälschten Audio-Dateien mit "Entschuldigung"

2023-11-14
RP Online
Why's our monitor labelling this an incident or hazard?
The event involves AI systems generating realistic fake audio content (deepfakes) that are being used to spread false narratives. This constitutes harm to communities by disseminating misinformation and undermining trust in media, which fits the definition of an AI Incident. The harm is realized as the fake audios are already circulating and misleading the public, not merely a potential risk.
Thumbnail Image

"Manipulation und Lügen in der Berichterstattung": "Tagesschau" warnt vor Fälschungen

2023-11-14
T-online.de
Why's our monitor labelling this an incident or hazard?
The use of AI to generate fake audio recordings that spread false claims and misinformation constitutes an AI Incident because it directly harms communities by disseminating deceptive content that can erode trust in media and misinform the public. The AI system's role in producing these falsified audios is pivotal to the harm caused, fulfilling the criteria for an AI Incident under harm to communities and violation of rights (e.g., right to truthful information).
Thumbnail Image

"Tagesschau": Achtung, Betrug! KI-generierte Fälschungen im Umlauf

2023-11-13
Bild
Why's our monitor labelling this an incident or hazard?
The event explicitly describes the use of AI-generated audio deepfakes to create false content that misleads the public and spreads disinformation. This constitutes harm to communities by damaging public trust and spreading falsehoods, fulfilling the criteria for an AI Incident. The AI system's use is central to the harm, as the fake audios would not exist without AI-generated voice synthesis. Therefore, this is an AI Incident due to realized harm caused by AI misuse.
Thumbnail Image

Fake News: Warnung vor gefälschten Tagesschau-Audiodateien

2023-11-14
Chip
Why's our monitor labelling this an incident or hazard?
The event involves AI systems generating fake audio content that directly leads to harm to communities by spreading misinformation and conspiracy theories. The AI-generated deepfakes are used maliciously to deceive the public, which constitutes a violation of rights to truthful information and causes social harm. Therefore, this qualifies as an AI Incident due to the realized harm caused by the AI system's use in generating and spreading false information.
Thumbnail Image

Daubner und Riewa gekapert: KI-Missbrauch erschüttert "Tagesschau"

2023-11-13
Focus
Why's our monitor labelling this an incident or hazard?
The event involves AI systems used to generate fake audio content impersonating real individuals, which is a clear AI system involvement. The use of these AI-generated audios has directly caused harm by spreading false information and enabling scams, fulfilling the criteria for an AI Incident. The harm includes misinformation to the public (harm to communities) and fraudulent use of AI-generated content (violation of rights and harm). Therefore, this is classified as an AI Incident.
Thumbnail Image

Tagesschau warnt vor gefälschten Audiodateien

2023-11-14
Frankfurter Allgemeine
Why's our monitor labelling this an incident or hazard?
The event explicitly describes AI-generated audio deepfakes used to spread false claims and manipulate public opinion, which is a direct harm to communities by spreading misinformation. The AI system's use is central to the harm, as it enables the creation of realistic but fake audio that deceives listeners. Therefore, this qualifies as an AI Incident due to realized harm from AI-generated disinformation.
Thumbnail Image

ARD-Tagesschau warnt vor Audio-Fakes mit prominenten Sprechern

2023-11-13
computerbild.de
Why's our monitor labelling this an incident or hazard?
The event explicitly involves AI-generated audio fakes, which are AI systems used maliciously to produce false content. The harm is realized as these fakes are actively spreading disinformation, undermining trust in the media and misleading the public. This constitutes harm to communities and a violation of rights related to truthful information. Therefore, this qualifies as an AI Incident due to the direct role of AI in causing harm through misinformation dissemination.
Thumbnail Image

Fake Tagesschau: KI generierte Audiodatei kursiert

2023-11-14
heise online
Why's our monitor labelling this an incident or hazard?
The use of AI voice cloning to create fake news audio that is disseminated publicly and intended to deceive listeners constitutes an AI Incident. The AI system's use directly leads to misinformation and reputational harm, which affects communities and public trust. The article describes actual circulation and impact, not just a potential risk, so it is not merely a hazard. It is not complementary information because the main focus is on the incident itself, not on responses or broader ecosystem context. Therefore, this event qualifies as an AI Incident.
Thumbnail Image

Fake-Alarm bei ARD: Sender warnt vor Lügengeschichten

2023-11-14
GIGA
Why's our monitor labelling this an incident or hazard?
The article explicitly states that AI was used to generate fake audio messages that imitate known news anchors and falsely claim an apology for alleged lies. This use of AI-generated content is causing harm by spreading disinformation and eroding trust in a public news broadcaster, which constitutes harm to communities. Therefore, this qualifies as an AI Incident because the AI system's use has directly led to harm through misinformation and manipulation of public perception.
Thumbnail Image

ARD warnt vor gefälschten "Tagesschau"-Aufnahmen

2023-11-14
Merkur.de
Why's our monitor labelling this an incident or hazard?
The article explicitly states that AI was used to generate fake audio files mimicking the 'Tagesschau' news broadcast, including voices of known presenters. These fakes are being used to spread false narratives about serious topics like the pandemic and the Ukraine war, which constitutes harm to communities through misinformation. The AI system's use is central to the creation and dissemination of these harmful fakes, meeting the criteria for an AI Incident due to realized harm from AI-generated disinformation.
Thumbnail Image

Tagesschau warnt vor Audio-Fakes mit angeblichen "Entschuldigungen"

2023-11-14
WinFuture.de
Why's our monitor labelling this an incident or hazard?
The event involves AI systems used to create manipulated audio files (deepfakes) that impersonate real news anchors. The use of AI-generated content to spread false information and manipulate public perception constitutes harm to communities and society. Since the harm (disinformation and societal manipulation) is actively occurring through these AI-generated fakes, this qualifies as an AI Incident under the definition of harm to communities caused directly by AI system use.
Thumbnail Image

"Tagesschau" wird Opfer von KI-Kriminellen: "Lügen Ihnen dreist ins Gesicht"

2023-11-14
TAG24
Why's our monitor labelling this an incident or hazard?
The event explicitly describes the use of AI to produce fake audio files impersonating real news anchors, spreading false claims about the news organization's integrity. This is a direct use of AI-generated content to cause harm by misleading the public and damaging trust, which fits the definition of an AI Incident involving harm to communities. The harm is realized as the fake audios are already in circulation, not just a potential risk.
Thumbnail Image

"Tagesschau": ARD spricht Warnung an Zuschauer aus

2023-11-14
watson.de/
Why's our monitor labelling this an incident or hazard?
The event involves AI systems used to generate deepfake audio impersonations of news anchors, which have been disseminated publicly, including at a demonstration. This use of AI has directly caused harm by spreading disinformation and manipulating public perception, fulfilling the criteria for an AI Incident under harm to communities and violation of rights. The harm is realized, not just potential, as the fake audios are actively circulating and misleading people.
Thumbnail Image

Gefakte Tagesschau-Audiodateien im Umlauf

2023-11-16
swr
Why's our monitor labelling this an incident or hazard?
The article explicitly discusses AI-based voice cloning technology used to create fake audio clips impersonating trusted news anchors. These fakes are disseminated with the intent to deceive and damage trust in public broadcasting, which is a clear harm to communities and a violation of personal rights. The harm is realized as the fake audios are already in circulation and causing confusion and mistrust. Therefore, this qualifies as an AI Incident because the AI system's use has directly led to harm through misinformation and rights violations.
Thumbnail Image

Tagesschau entschuldigt sich für Berichterstattung? Das steckt dahinter

2023-11-14
Nordkurier Online
Why's our monitor labelling this an incident or hazard?
The event explicitly involves AI-generated audio files (deepfakes) used to spread false information and undermine trust in public broadcasting. The harm is realized as misinformation is actively disseminated, which harms communities by eroding trust and spreading false narratives. The AI system's use is central to the incident, as the fake audio would not exist without AI generation. This fits the definition of an AI Incident because the AI's use has directly led to harm to communities through misinformation and manipulation.
Thumbnail Image

Gefälschte Audiodateien der "Tagesschau" im Umlauf

2023-11-13
WAZ/AZ-online.de
Why's our monitor labelling this an incident or hazard?
The event involves AI systems generating fake audio content impersonating trusted news sources, which is then used to spread disinformation. This directly leads to harm to communities by damaging the democratic order and spreading false narratives. The AI-generated nature of the audio is explicitly mentioned, and the harm is ongoing and realized through public dissemination and influence. Therefore, this qualifies as an AI Incident under the definition of harm to communities caused by AI-generated disinformation.
Thumbnail Image

Gefälschte Audiodateien der Tagesschau im Umlauf

2023-11-13
LVZ - Leipziger Volkszeitung
Why's our monitor labelling this an incident or hazard?
The event involves AI systems generating fake audio recordings that impersonate trusted news anchors to spread false information. This use of AI directly leads to harm by damaging the credibility of a public news organization and spreading disinformation that threatens democratic values and social cohesion. The harm is realized as these audios have been played at public demonstrations and widely shared on social media, influencing public perception and trust. Hence, it meets the criteria for an AI Incident because the AI-generated content has directly caused harm to communities and democratic order through misinformation.
Thumbnail Image

ARD warnt vor gefälschten "Tagesschau"-Audiodateien - DWDL.de

2023-11-13
DWDL.de
Why's our monitor labelling this an incident or hazard?
The article describes AI-generated manipulated audio files that falsely represent 'Tagesschau' presenters apologizing for alleged misinformation. This use of AI to create deceptive content is directly linked to the spread of disinformation, which harms communities and threatens democratic values. Although no physical harm is reported, the harm to societal trust and democratic order qualifies as harm to communities and a violation of rights. Therefore, this constitutes an AI Incident due to the realized harm caused by the AI system's misuse in generating fake audio content.
Thumbnail Image

Gefälschte Audiodateien der "Tagesschau" im Umlauf

2023-11-13
DNN - Dresdner Neueste Nachrichten
Why's our monitor labelling this an incident or hazard?
The event involves AI systems generating fake audio content impersonating trusted news sources to spread disinformation. This use of AI directly causes harm by misleading the public, damaging the democratic order, and spreading false narratives. The harm is realized and ongoing, as the audios have been played at public demonstrations and shared widely, fulfilling the criteria for an AI Incident involving harm to communities and violation of rights.
Thumbnail Image

ARD: Warnung vor Fake-Tagesschau-Audios - worauf Sie achten sollten

2023-11-14
OTZ - Ostthüringer Zeitung
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI-generated audio fakes that impersonate trusted news anchors to spread false narratives about COVID-19, the Ukraine war, and other topics. This use of AI has directly caused harm by misleading the public and undermining democratic values, which qualifies as harm to communities and a violation of rights. The AI system's role in generating these audios is central to the incident, fulfilling the criteria for an AI Incident.
Thumbnail Image

ARD und Tagesschau warnen vor gefälschten Audio-Dateien

2023-11-14
Braunschweiger Zeitung
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI-generated audio fakes that impersonate news anchors to spread false narratives about COVID-19, the Ukraine war, and other topics. These fakes have been disseminated widely, including at public demonstrations and on social media, causing harm to communities by spreading misinformation and potentially destabilizing democratic norms. The AI system's use in creating these audios is central to the harm occurring, fulfilling the criteria for an AI Incident involving violations of rights and harm to communities.
Thumbnail Image

Gefälschte Audiodateien der Tagesschau im Umlauf

2023-11-13
LZ online
Why's our monitor labelling this an incident or hazard?
The event involves AI systems generating fake audio content that is used to spread false narratives and disinformation. This has already caused harm by misleading the public and damaging the democratic order, fulfilling the criteria for an AI Incident. The harm is realized, not just potential, as the fake audios have been played at public demonstrations and widely disseminated on social media, influencing public perception and trust. Therefore, this qualifies as an AI Incident due to direct harm to communities and democratic rights through AI-enabled misinformation.
Thumbnail Image

Gefälschte Meldungen - KI-Missbrauch erschüttert Tagesschau

2023-11-13
TV Spielfilm Online
Why's our monitor labelling this an incident or hazard?
The article describes the use of AI to generate fake audio files that impersonate news anchors and falsely claim manipulation by the news organization. This is a clear case of AI misuse causing harm to communities through misinformation. The AI system's outputs are central to the harm occurring, fulfilling the criteria for an AI Incident involving violations of rights to truthful information and harm to communities.