AI Voice Cloning Scam Targets Influencer's Father

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Criminals used AI voice cloning technology to impersonate influencer Dario Centurione, tricking his father into transferring R$600 via a phone scam. The attackers reportedly used publicly available audio from Centurione's online content to generate the fake voice, highlighting the risks of AI-enabled identity fraud.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly mentions the use of AI to clone the influencer's voice, which was then used to deceive his father into transferring money via a fraudulent loan request. This constitutes direct harm to a person (financial loss) caused by the use of an AI system. Therefore, this qualifies as an AI Incident under the definition of harm caused by the use of an AI system.[AI generated]
AI principles
AccountabilityPrivacy & data governanceRobustness & digital securitySafetyTransparency & explainabilityRespect of human rightsHuman wellbeing

Industries
Media, social platforms, and marketingDigital security

Affected stakeholders
Consumers

Harm types
Economic/PropertyReputationalPsychological

Severity
AI incident

Business function:
Other

AI system task:
Content generation


Articles about this incident or hazard

Thumbnail Image

Influencer diz que golpistas clonaram sua voz com inteligência artificial

2023-05-15
Jornal Estado de Minas | Not�cias Online
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of AI to clone the influencer's voice, which was then used to deceive his father into transferring money via a fraudulent loan request. This constitutes direct harm to a person (financial loss) caused by the use of an AI system. Therefore, this qualifies as an AI Incident under the definition of harm caused by the use of an AI system.
Thumbnail Image

Influencer afirma que a voz foi clonada em golpe contra seu pai; entenda - Mundo - Diário do Nordeste

2023-05-13
Diário do Nordeste
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of AI to clone the influencer's voice, which was then used by criminals to deceive his father into transferring money. This constitutes direct harm (financial loss) caused by the use of an AI system (voice cloning technology). Therefore, this qualifies as an AI Incident due to realized harm resulting from the use of an AI system.
Thumbnail Image

Influencer diz que teve voz clonada por IA e que ela foi usada contra o pai

2023-05-12
uol.com.br
Why's our monitor labelling this an incident or hazard?
The article explicitly states that AI was used to clone the influencer's voice by analyzing publicly available videos, creating a voice deepfake that was then used by scammers to deceive the influencer's father into transferring money. This is a direct harm caused by the AI system's use, fulfilling the criteria for an AI Incident. The harm is financial loss due to fraud, which is a significant harm to a person. The AI system's role is pivotal as the scam relied on the AI-generated voice to convince the victim. Therefore, this event is classified as an AI Incident.
Thumbnail Image

Golpistas usam IA para clonar voz e pedir pix, diz influencer

2023-05-12
Terra
Why's our monitor labelling this an incident or hazard?
The event explicitly involves the use of AI-based voice cloning technology (deepfake audio) to impersonate a person and commit a financial scam. This use of AI directly led to harm, as the victim's father was deceived into transferring money. The harm is financial and personal, fitting under harm to persons or communities. Therefore, this qualifies as an AI Incident because the AI system's use directly caused harm through fraudulent activity.
Thumbnail Image

Influencer tem voz clonada por IA e sofre golpe

2023-05-12
Olhar Digital - O futuro passa primeiro aqui
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI technology to clone a person's voice, which was then used maliciously to commit a financial scam. The AI system's use directly led to harm (financial loss) to the victim, fulfilling the criteria for an AI Incident due to violation of property rights and harm to individuals through deception.
Thumbnail Image

Influencer diz que teve voz clonada por IA e usada contra o pai em golpe; entenda o caso - Hugo Gloss

2023-05-12
Hugo Gloss
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of AI to clone the influencer's voice, which was then used by criminals to impersonate him and scam his father out of money. This is a direct use of an AI system (voice cloning technology) leading to harm (financial loss) to a person. The harm is realized, not just potential, and the AI system's role is pivotal in enabling the scam. Therefore, this qualifies as an AI Incident under the framework, specifically harm to a person through malicious use of AI-generated voice cloning.
Thumbnail Image

Influenciador tem voz clonada em novo golpe na internet: - Notícia - Bahia Notícias

2023-05-12
Marcelo Bittencourt
Why's our monitor labelling this an incident or hazard?
The article describes how AI was used to clone the influencer's voice to impersonate him in phone calls and messages, leading to a scam where victims, including the influencer's father, were tricked into transferring money. This constitutes direct harm caused by the use of an AI system (voice cloning technology) in a fraudulent scheme, fulfilling the criteria for an AI Incident due to harm to persons (financial harm) and communities (victims of scams).