German News Anchor Deepfaked in AI-Driven Investment Scam

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Fraudsters used AI deepfake technology to create a fake video of 'Tagesschau' news anchor André Schünke endorsing a fraudulent investment platform called 'Quantum.' The manipulated video, circulating on Facebook, misleads viewers by exploiting Schünke's reputation, potentially causing financial harm and spreading misinformation.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves the use of an AI system to create deepfake content that impersonates a public figure to promote a fraudulent investment platform. This misuse of AI directly leads to harm by deceiving individuals and potentially causing financial loss, which constitutes harm to people. Therefore, this qualifies as an AI Incident because the AI system's use has directly led to harm through fraud and deception.[AI generated]
AI principles
Transparency & explainabilityPrivacy & data governanceRespect of human rightsRobustness & digital securitySafetyAccountabilityDemocracy & human autonomy

Industries
Media, social platforms, and marketingFinancial and insurance servicesDigital security

Affected stakeholders
WorkersConsumersGeneral public

Harm types
Economic/PropertyReputationalHuman or fundamental rightsPublic interest

Severity
AI incident

Business function:
Marketing and advertisement

AI system task:
Content generation


Articles about this incident or hazard

Thumbnail Image

"Tagesschau"-Sprecher: André Schünke wird Opfer von KI-Betrug - freenet.de

2023-08-11
freenet.de Start
Why's our monitor labelling this an incident or hazard?
The event involves the use of an AI system to create deepfake content that impersonates a public figure to promote a fraudulent investment platform. This misuse of AI directly leads to harm by deceiving individuals and potentially causing financial loss, which constitutes harm to people. Therefore, this qualifies as an AI Incident because the AI system's use has directly led to harm through fraud and deception.
Thumbnail Image

KI-Betrüger klauen "Tagesschau"-Sprecher für Fake-Werbe-Video

2023-08-11
GMX
Why's our monitor labelling this an incident or hazard?
The event involves an AI system explicitly used to create a deepfake video impersonating a trusted news presenter to promote a fraudulent financial product. This misuse of AI has directly led to harm by spreading misinformation and potentially causing financial losses to viewers. The harm is realized, not just potential, as the video was widely shared and could deceive people. Hence, it meets the criteria for an AI Incident, as the AI system's use has directly led to harm to communities and individuals through deception and fraud.
Thumbnail Image

Miese Aktien-Falle: Tagesschau-Sprecher von KI-Betrügern missbraucht!

2023-08-10
Bild
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI-generated deepfake technology to create misleading content that directly facilitates a financial scam. The AI system's use in fabricating the presenter's voice and image is central to the harm caused, as it deceives individuals into investing in a fraudulent platform, leading to financial losses. This meets the criteria for an AI Incident because the AI system's use has directly led to harm (financial fraud and deception of the public).
Thumbnail Image

Betrüger klonten seine Stimme: "Tagesschau"-Sprecher warnt vor Fake-Video im Internet

2023-08-11
stern.de
Why's our monitor labelling this an incident or hazard?
The article describes a clear case where AI was used to clone a person's voice to produce a fake video promoting a financial scam. The AI system's use directly leads to harm by misleading people and potentially causing financial loss, which fits the definition of an AI Incident. The harm to individuals (fraud, deception) and to the community's trust in media is evident. The event is not merely a potential risk but an active incident with ongoing harm, thus it is classified as an AI Incident.
Thumbnail Image

Tagesschau-Sprecher André Schünke wird Opfer von KI-Betrügern

2023-08-11
rtl.de
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of AI technology to create fake videos of well-known personalities to promote a fraudulent investment platform. This involves an AI system generating deceptive content that misleads people, constituting harm to individuals (financial harm) and communities (through fraud). Therefore, this qualifies as an AI Incident because the AI system's use has directly led to harm through deception and potential financial loss.
Thumbnail Image

Betrüger nutzen Tagesschau-Sprecher als Werbe-Fake: "Es kann einem schon Angst machen"

2023-08-11
Merkur.de
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of AI to create a fake video and voice of the Tagesschau presenter, which was used in a fraudulent advertisement. This misuse of AI has directly caused harm by misleading the public and potentially causing financial losses. The harm includes violation of personal rights (unauthorized use of image and voice), reputational damage, and the risk of financial harm to investors. The AI system's role is pivotal in enabling the creation of convincing fake content. Hence, this event meets the criteria for an AI Incident.
Thumbnail Image

Achtung, Fake! Tagesschau-Moderator "wirbt" in Video für dubiose Plattform

2023-08-11
MOPO.de
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI (deepfake technology) to manipulate video content, creating a false endorsement that exploits the anchor's reputation. This misuse of AI directly leads to harm by deceiving people, potentially causing financial loss and spreading false information, which harms communities and violates trust. Therefore, it qualifies as an AI Incident due to realized harm from AI misuse.
Thumbnail Image

ARD: "Tagesschau"-Sprecher reagiert auf heftige Fake-Aktion

2023-08-11
watson.de/
Why's our monitor labelling this an incident or hazard?
The event involves an AI system generating a deepfake video that impersonates a public figure to promote a fraudulent product, which is a direct misuse of AI technology leading to harm through misinformation and potential financial loss to victims. The AI system's use here directly led to harm (misleading the public, potential fraud), fulfilling the criteria for an AI Incident. The anchor's warning about future risks underscores the seriousness of the harm already caused.
Thumbnail Image

'Tagesschau'-Sprecher geschockt: Andre Schünke wird durch Künstliche Intelligenz für Betrug missbraucht

2023-08-11
Abendzeitung München
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems to create deepfake videos that impersonate a public figure to deceive people into trusting and potentially purchasing fraudulent financial services. This misuse of AI directly leads to harm by facilitating fraud and misleading consumers, which constitutes harm to communities and individuals. Therefore, it qualifies as an AI Incident due to the realized harm caused by the AI system's malicious use.
Thumbnail Image

"Tagesschau"-Sprecher: André Schünke wird Opfer von KI-Betrug

2023-08-11
Weser Kurier
Why's our monitor labelling this an incident or hazard?
The event explicitly describes the use of AI to create a fraudulent deepfake video that misleads viewers into believing a trusted news anchor endorses a scam financial product. The AI system's use directly causes harm by enabling fraud and misinformation, which can lead to financial losses and reputational damage. This fits the definition of an AI Incident because the AI system's use has directly led to harm to individuals (financial harm) and communities (misinformation and deception).
Thumbnail Image

KI-Betrüger nutzen Tagesschau-Sprecher für dubiose Onlineabzocke

2023-08-11
Focus
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of AI to generate fake videos and synthetic voice of a trusted news presenter to promote a dubious financial product, which is a scam. This use of AI directly leads to harm by misleading and defrauding people, fulfilling the criteria for an AI Incident under harm to communities and violation of rights. The harm is realized, not just potential, as the scam is actively ongoing. Hence, the classification is AI Incident.
Thumbnail Image

"Tagesschau"-Sprecher: André Schünke wird Opfer von KI-Betrug

2023-08-11
KN - Kieler Nachrichten
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI to create a deepfake video that impersonates a trusted public figure to promote a fraudulent financial scheme. The AI system's use directly leads to harm by enabling deception and potential financial loss to victims, fulfilling the criteria for an AI Incident under harm to communities and individuals. The AI system's role is pivotal in generating the fake endorsement, and the harm is realized, not just potential. Hence, the classification is AI Incident.