Criminals Use AI and Deepfakes to Escalate Identity Fraud in the UK

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Fraud prevention body Cifas reports a surge in AI-enabled identity fraud, with criminals using deepfake images, videos, and audio for phishing scams and account takeovers. Over 374,000 fraud cases were reported in 2023, with identity theft accounting for nearly two-thirds, causing significant financial and personal harm to consumers.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly mentions the use of AI and deepfake technology by criminals to perpetrate identity fraud and social engineering scams, which have resulted in actual financial harm to victims. The AI systems are involved in the misuse and malicious use of AI-generated content and techniques to steal consumer details and commit fraud. This constitutes an AI Incident because the AI system's use has directly led to harm (financial loss and identity theft) to people and communities. The harm is realized and ongoing, not merely potential, and the AI role is pivotal in enabling sophisticated fraud methods.[AI generated]
AI principles
Privacy & data governanceRespect of human rightsRobustness & digital securitySafetyTransparency & explainabilityAccountabilityHuman wellbeing

Industries
Digital securityFinancial and insurance services

Affected stakeholders
Consumers

Harm types
Economic/PropertyPsychologicalReputationalHuman or fundamental rights

Severity
AI incident

AI system task:
Content generation


Articles about this incident or hazard

Thumbnail Image

Criminals ramp up social engineering and AI tactics to steal consumer details

2024-04-15
Yahoo! Finance
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of AI and deepfake technology by criminals to perpetrate identity fraud and social engineering scams, which have resulted in actual financial harm to victims. The AI systems are involved in the misuse and malicious use of AI-generated content and techniques to steal consumer details and commit fraud. This constitutes an AI Incident because the AI system's use has directly led to harm (financial loss and identity theft) to people and communities. The harm is realized and ongoing, not merely potential, and the AI role is pivotal in enabling sophisticated fraud methods.
Thumbnail Image

How to keep your money safe - as criminals ramp up AI tactics to steal consumer data

2024-04-16
Yahoo! Finance
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI systems being used by criminals to generate convincing fraudulent content and deepfake voices, which have directly contributed to significant financial fraud and identity theft. This constitutes harm to persons and communities (financial and privacy harms). The article also references AI-powered fraud detection systems as a countermeasure, but the primary focus is on the realized harms caused by malicious AI use. Hence, this qualifies as an AI Incident due to direct harm caused by AI-enabled criminal activity.
Thumbnail Image

Criminals ramp up social engineering and AI tactics to steal...

2024-04-15
Daily Mail Online
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI and deepfake technology being used by criminals to perpetrate identity fraud and social engineering scams, which have resulted in substantial financial losses and harm to victims. The AI systems' use in generating sophisticated phishing scams and spoofing voices directly contributes to the harm. This meets the criteria for an AI Incident because the AI system's use has directly led to harm (financial and rights violations). The event is not merely a potential risk or a response update but a report of ongoing harm caused by AI-enabled fraud.
Thumbnail Image

Criminals ramp up social engineering and AI tactics to steal consumer details

2024-04-15
The Independent
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems (deepfake technology and AI-enabled data harvesting) in the commission of identity theft and account takeover fraud, which directly harms consumers and financial institutions. The harms include violations of personal and financial rights, financial losses, and exploitation of vulnerable individuals. Since the AI system's use has directly led to realized harm (fraud and identity theft), this qualifies as an AI Incident under the framework.
Thumbnail Image

How to keep your money safe - as criminals ramp up AI tactics to steal consumer data

2024-04-16
The Independent
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of AI and deepfake technology by criminals to commit fraud and identity theft, which have directly led to financial harm to consumers. The harms include monetary losses, compromised personal data, and social engineering scams facilitated by AI-generated content. This fits the definition of an AI Incident because the AI systems' use by criminals has directly caused harm to people (financial and privacy harm). The article is not merely about potential risks or general AI developments, but about actual fraud cases involving AI tactics. Therefore, the event is classified as an AI Incident.
Thumbnail Image

Criminals using AI and deepfake technology to steal consumer details

2024-04-16
EXPRESS
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI-enabled identity fraud, including sophisticated phishing scams and deepfake technology used to steal identities and take over customer accounts. This constitutes direct harm to individuals through identity theft and financial loss, as well as violations of privacy and potentially other rights. The AI systems are used maliciously by criminals to facilitate these harms, meeting the criteria for an AI Incident.
Thumbnail Image

Criminals are using AI and deepfake technology to steal consumer details

2024-04-16
Mirror
Why's our monitor labelling this an incident or hazard?
The article explicitly states that AI and deepfake technology are being used by criminals to steal consumer details and commit identity fraud, which has directly led to harm such as financial losses and identity theft. The AI system's use is malicious and contributes to the harm. The event involves realized harm (fraud cases reported and prevented losses), so it is an AI Incident rather than a hazard or complementary information. The involvement of AI in the fraud and the resulting harm to individuals and organizations fits the definition of an AI Incident.
Thumbnail Image

The dark side of artificial intelligence leaves consumers vulnerable to fraud

2024-04-16
Yorkshire Post
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI-enabled identity fraud using deepfake images, videos, and audio, which are AI systems generating deceptive content. These AI systems are being used by criminals to directly cause harm to consumers through fraud. The harm is realized, not just potential, as consumers are being targeted and victimized. Hence, this is an AI Incident due to the direct link between AI system use and harm to people.
Thumbnail Image

Criminals 'using AI tactics to steal consumer details'

2024-04-16
STV News
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems (deepfake technology, AI-enabled phishing, spoof voices) by criminals to commit identity fraud and account takeovers, which have directly caused harm to consumers by stealing their personal and financial information. This fits the definition of an AI Incident because the AI system's use has directly led to harm (identity theft, financial loss). The article describes realized harm rather than potential harm, so it is not an AI Hazard. It is not merely complementary information because the main focus is on the harm caused by AI-enabled fraud, not on responses or updates. Therefore, the classification is AI Incident.