AI-Generated Deepfakes Used to Defraud Using Daniel Sarcos and Olga Tañón's Likenesses

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

AI was used to synthesize the voices and images of Daniel Sarcos and Olga Tañón without their consent to create fraudulent advertisements for a credit score company. Both celebrities publicly denounced the misuse, warning of reputational harm and potential financial scams targeting the public.[AI generated]

Why's our monitor labelling this an incident or hazard?

An AI system was used to generate synthetic voice audio impersonating Daniel Sarcos without his consent, which is a misuse of AI leading to reputational harm and potential fraud. This misuse directly harms the individual (violation of rights and potential financial harm to victims of the scam) and thus qualifies as an AI Incident. The event involves the use of AI-generated content for fraudulent purposes, which is a clear harm caused by AI misuse.[AI generated]
AI principles
AccountabilityPrivacy & data governanceRespect of human rightsTransparency & explainabilityDemocracy & human autonomy

Industries
Financial and insurance services

Affected stakeholders
General publicOther

Harm types
ReputationalEconomic/PropertyHuman or fundamental rights

Severity
AI incident

Business function:
Marketing and advertisement

AI system task:
Content generation


Articles about this incident or hazard

Thumbnail Image

Daniel Sarcos alerta que le robaron su voz con inteligencia artificial: "No tengo nada que ver con esta gente" (VIDEO)

2024-03-21
LaPatilla.com
Why's our monitor labelling this an incident or hazard?
An AI system was used to generate synthetic voice audio impersonating Daniel Sarcos without his consent, which is a misuse of AI leading to reputational harm and potential fraud. This misuse directly harms the individual (violation of rights and potential financial harm to victims of the scam) and thus qualifies as an AI Incident. The event involves the use of AI-generated content for fraudulent purposes, which is a clear harm caused by AI misuse.
Thumbnail Image

Enérgico, Daniel Sarcos denuncia el mal uso de su voz e imagen: 'Realmente estoy indignado'

2024-03-20
Hola.com
Why's our monitor labelling this an incident or hazard?
The article explicitly states that AI was used to simulate Daniel Sarcos's voice and combine it with images to promote a fraudulent campaign without his permission. This misuse of AI directly leads to harm by enabling scams and deceiving people, which is a clear harm to communities and a violation of rights. The involvement of AI in generating synthetic media for fraudulent purposes meets the criteria for an AI Incident, as the harm is occurring and the AI system's role is pivotal in causing it.
Thumbnail Image

Olga Tañón y Daniel Sarcos denuncian uso de IA para suplantar su imagen

2024-03-23
El Pitazo
Why's our monitor labelling this an incident or hazard?
The article explicitly states that an AI system was used to generate synthetic voices and images of celebrities without authorization, which is a misuse of AI technology leading to harm. The harm includes fraud, deception, and violation of the celebrities' rights. Since the harm is occurring and directly linked to the AI system's use, this qualifies as an AI Incident under the framework, specifically under violations of human rights and intellectual property rights.
Thumbnail Image

Daniel Sarcos está "indignado" por el mal uso de su voz e imagen para publicidad engañosa - El Diario NY

2024-03-21
El Diario Nueva York
Why's our monitor labelling this an incident or hazard?
The article explicitly states that AI was used to synthesize Daniel Sarcos's voice and manipulate his image to create deceptive videos promoting a fraudulent credit score service. This misuse of AI has directly caused harm by misleading people and potentially causing financial and reputational damage. Therefore, this qualifies as an AI Incident because the AI system's use has directly led to harm to individuals and communities through fraud and misinformation.
Thumbnail Image

¡Preocupante! Daniel Sarcos denuncia que ha sido víctima de un fraude (+Video)

2024-03-21
Meridiano Web
Why's our monitor labelling this an incident or hazard?
The article explicitly states that AI was used to synthesize Daniel Sarcos's voice and image to create fake advertisements for a fraudulent company. This misuse of AI has directly led to harm by facilitating fraud and deception, which is a clear AI Incident under the framework. The harm includes violation of personal rights and potential financial harm to victims of the scam. The involvement of AI in generating synthetic media used for fraud is central to the incident.