AI-Generated Deepfakes of Celebrities Used in Financial Scams Across Latin America

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

AI-generated deepfake videos and voices impersonating public figures like Carlos Slim and Elon Musk are being used to lure victims into online financial scams across Latin America. These convincing deepfakes have led to real financial losses, making it harder for users to distinguish legitimate content from fraudulent schemes.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly mentions the use of AI to create deepfake videos and voices of public figures to lure victims into financial scams. The harm is direct financial loss to individuals who fall for these scams. The AI system's use in generating realistic fake content is pivotal to the scam's success, fulfilling the criteria for an AI Incident involving harm to people. The article also discusses the challenges in detecting such AI-generated content and the ongoing efforts to mitigate these harms, but the primary event is the realized harm caused by AI-generated deepfakes used in scams.[AI generated]
AI principles
AccountabilityTransparency & explainabilitySafetyRespect of human rightsDemocracy & human autonomy

Industries
Media, social platforms, and marketingFinancial and insurance services

Affected stakeholders
Consumers

Harm types
Economic/Property

Severity
AI incident

AI system task:
Content generation


Articles about this incident or hazard

Thumbnail Image

'Deepfakes' de famosos y políticos: un nuevo anzuelo de las estafas financieras en línea

2024-03-20
infobae
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of AI to create deepfake videos and voices of public figures to lure victims into financial scams. The harm is direct financial loss to individuals who fall for these scams. The AI system's use in generating realistic fake content is pivotal to the scam's success, fulfilling the criteria for an AI Incident involving harm to people. The article also discusses the challenges in detecting such AI-generated content and the ongoing efforts to mitigate these harms, but the primary event is the realized harm caused by AI-generated deepfakes used in scams.
Thumbnail Image

Deepfakes' de famosos y políticos: Un nuevo anzuelo de las estafas financieras en línea

2024-03-20
Noticias SIN
Why's our monitor labelling this an incident or hazard?
The event involves AI systems explicitly through the creation of deepfake videos and synthetic voices used to impersonate public figures. These AI-generated deepfakes are used maliciously to deceive individuals into financial scams, causing direct financial harm to victims. The article provides concrete examples of such scams occurring, including victims transferring large sums of money based on AI-generated content. This meets the definition of an AI Incident because the AI system's use has directly led to harm (financial loss) to people. The article also discusses the challenges in detecting these deepfakes and the ongoing efforts by social media platforms to mitigate the issue, but the primary focus is on the realized harm from AI misuse.
Thumbnail Image

'Deepfakes' de famosos y políticos: un nuevo anzuelo de las estafas financieras en línea - Tecnología - ABC Color

2024-03-21
ABC Digital
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI-generated deepfakes (voice and video) used to impersonate public figures to lure victims into financial scams. The AI system's outputs (deepfake content) are directly used to deceive and cause financial harm to individuals, fulfilling the criteria for an AI Incident. The harm is realized (people have been scammed), and the AI system's role is pivotal in creating convincing fraudulent content. This goes beyond general AI news or potential hazards, as actual harm has occurred due to the AI system's use.
Thumbnail Image

Deepfakes o videos falsos de famosos: un anzuelo para las estafas financieras en línea

2024-03-20
Última Hora
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI-generated deepfake videos and voices used to impersonate public figures to lure victims into financial scams. The harm is direct and realized, as victims have transferred money based on these AI-generated fraudulent materials. The AI system's use in creating these deceptive contents is central to the incident, fulfilling the criteria for an AI Incident involving harm to individuals (financial harm) and communities (trust and security).
Thumbnail Image

'Deepfakes' de famosos y políticos: un nuevo anzuelo de las estafas financieras en línea

2024-03-23
UDG TV
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI-generated deepfakes (voice and video) used to impersonate public figures like Carlos Slim and Elon Musk to trick people into financial scams. These scams have resulted in actual financial losses, which constitute harm to persons. The AI system's use in generating these deepfakes is central to the harm caused, fulfilling the criteria for an AI Incident. The harm is direct and realized, not merely potential, and involves violations of trust and financial harm to individuals, fitting the definition of an AI Incident under harm to persons and communities.
Thumbnail Image

'Deepfakes' de famosos y políticos: un nuevo anzuelo de las estafas financieras en línea - ElPeriodicoDeMexico.Com

2024-03-21
Periódico de México
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of AI to create deepfake videos and voices that convincingly impersonate public figures to lure victims into financial scams. This involves the use of AI systems for content generation (deepfakes) that directly cause harm (financial loss) to individuals. The harm is not hypothetical but has already occurred, fulfilling the criteria for an AI Incident. The article also discusses the challenges in detecting these deepfakes and the ongoing efforts by social media platforms to mitigate the problem, but the primary focus is on the realized harm caused by AI-generated content used in scams.