AI Voice Cloning Scam Targets Spanish Film Company with Fake Benedict Cumberbatch

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Scammers used AI voice synthesis to impersonate actor Benedict Cumberbatch, contacting Spain's Peabody Films and requesting £200,000 under the guise of film collaboration. The company was deceived by the highly realistic AI-generated voice, nearly falling victim to fraud before confirming the scam with Cumberbatch’s real agent.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event explicitly involves AI systems used for voice synthesis to impersonate a celebrity, leading to an attempted financial scam. The AI system's use directly led to a harm scenario (fraud attempt), fulfilling the criteria for an AI Incident. The article also references the broader misuse of AI voice and image generation for scams, reinforcing the classification. Therefore, this is an AI Incident due to realized harm from AI misuse in voice fraud.[AI generated]
AI principles
Transparency & explainabilityRobustness & digital securitySafetyPrivacy & data governanceRespect of human rightsAccountability
Industries
Arts, entertainment, and recreationDigital security
Affected stakeholders
Business
Harm types
Economic/PropertyReputationalPsychological
Severity
AI incident
AI system task:
Content generation

Articles about this incident or hazard

Thumbnail Image

孙燕姿后轮到“卷福”？AI合成声音技术遭滥用 电信诈骗险些得手

2023-05-15
东方财富网
Why's our monitor labelling this an incident or hazard?
The event explicitly involves AI systems used for voice synthesis to impersonate a celebrity, leading to an attempted financial scam. The AI system's use directly led to a harm scenario (fraud attempt), fulfilling the criteria for an AI Incident. The article also references the broader misuse of AI voice and image generation for scams, reinforcing the classification. Therefore, this is an AI Incident due to realized harm from AI misuse in voice fraud.
Thumbnail Image

"卷福"主动找上门拍电影？AI冒充男星，诈骗西班牙电影公司20万英镑

2023-05-14
凤凰网（凤凰新媒体）
Why's our monitor labelling this an incident or hazard?
The event involves the use of an AI system (a text-to-speech AI capable of mimicking a person's voice) to commit fraud, which directly caused financial harm to the company. This fits the definition of an AI Incident because the AI system's use directly led to harm (financial loss) through deception. The harm is realized, not just potential, and the AI system's role is pivotal in enabling the scam.
Thumbnail Image

孙燕姿后轮到"卷福"？AI合成声音技术遭滥用 电信诈骗险些得手

2023-05-15
凤凰网（凤凰新媒体）
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI voice synthesis technology being used to impersonate Benedict Cumberbatch's voice to deceive a film company into believing they were communicating with the actor, leading to an attempted scam involving a large sum of money. This is a direct use of an AI system causing harm through fraud and deception, fulfilling the criteria for an AI Incident. The article also discusses the broader context of AI voice cloning and its misuse in scams, reinforcing the direct harm caused by AI misuse in this case.
Thumbnail Image

著名男星主动找上门拍电影？真相出人意料

2023-05-15
扬子网（扬子晚报）
Why's our monitor labelling this an incident or hazard?
The event involves the use of an AI text-to-speech system capable of mimicking a person's voice to perpetrate a scam. The AI system's use directly led to financial fraud attempts and deception, which are harms to persons and property. Therefore, this qualifies as an AI Incident because the AI system's use directly caused harm through fraudulent activity. The article also references the broader context of AI-generated voice fraud, reinforcing the AI system's pivotal role in the incident.
Thumbnail Image

孙燕姿后轮到"卷福"？AI合成声音技术遭滥用，电信诈骗险些得手

2023-05-15
金融界网
Why's our monitor labelling this an incident or hazard?
The event involves the use of an AI system (voice synthesis technology) to impersonate a real person's voice with 100% similarity, which was directly used in a scam attempt to extort money. This misuse of AI caused direct harm by attempting to defraud the film company, fitting the definition of an AI Incident due to harm to property and communities. The article clearly states the AI system's role in the scam and the resulting harm or near harm, meeting the criteria for an AI Incident rather than a hazard or complementary information.