AI Voice Cloning Used for Fraudulent Scams

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Starling Bank in the UK warns that AI can clone voices using just 3 seconds of audio from social media, enabling fraudsters to deceive victims' friends and family into transferring money. A survey revealed over a quarter of respondents were targeted by AI voice scams in the past year.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article describes actual scams in which an AI system (voice‐cloning technology) was used to commit fraud, directly harming victims by impersonating their voices and defrauding them. This constitutes realized harm through the development and misuse of an AI system, meeting the definition of an AI Incident.[AI generated]
AI principles
Privacy & data governanceTransparency & explainabilityRobustness & digital securitySafetyAccountabilityRespect of human rightsHuman wellbeingDemocracy & human autonomy
Industries
Financial and insurance servicesDigital securityMedia, social platforms, and marketing
Affected stakeholders
Consumers
Harm types
Economic/PropertyPsychologicalHuman or fundamental rightsReputational
AI system task:
Content generation

Articles about this incident or hazard