Deepfake Sextortion Scams Target Public Figures and Minors

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

AI-generated deepfakes have been used for sextortion scams in two incidents. In Nashville, former TV meteorologist Bree Smith’s doctored images were exploited for extortion, while in New Zealand deepfake images targeted minors, highlighting severe privacy violations and human rights breaches attributable to AI misuse.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly mentions AI-generated deepfake videos and AI-altered audio used to impersonate the victim in a harmful way. The harm includes violation of privacy and personal rights, emotional distress, and financial sextortion attempts, which fall under violations of human rights and significant harm to the individual. The AI system's use is central to the incident, as the deepfakes enabled the impersonation and scams. Therefore, this qualifies as an AI Incident. The legislative response is complementary information but does not change the primary classification.[AI generated]
AI principles
Privacy & data governanceRespect of human rightsSafetyAccountabilityRobustness & digital securityTransparency & explainability

Industries
Media, social platforms, and marketingDigital security

Affected stakeholders
WomenChildren

Harm types
Human or fundamental rightsPsychologicalReputationalEconomic/Property

Severity
AI incident

AI system task:
Content generation

In other databases

Articles about this incident or hazard

Thumbnail Image

TV meteorologist shaken by deepfake video in disturbing new craze

2025-05-02
Daily Mail Online
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI-generated deepfake videos and AI-altered audio used to impersonate the victim in a harmful way. The harm includes violation of privacy and personal rights, emotional distress, and financial sextortion attempts, which fall under violations of human rights and significant harm to the individual. The AI system's use is central to the incident, as the deepfakes enabled the impersonation and scams. Therefore, this qualifies as an AI Incident. The legislative response is complementary information but does not change the primary classification.
Thumbnail Image

Ex-TV meteorologist fights deepfakes after her image was doctored in scams

2025-05-01
Aol
Why's our monitor labelling this an incident or hazard?
The event involves AI systems in the form of deepfake technology used to create manipulated images and videos. The use of these AI-generated deepfakes has directly led to harm, including violations of personal rights, emotional distress, and financial extortion. Therefore, this qualifies as an AI Incident because the AI system's use has directly caused significant harm to individuals and communities. The legislative response is complementary information but does not change the classification of the primary event as an AI Incident.
Thumbnail Image

Former TV meteorologist fights deepfakes after her image was doctored in sextortion scams

2025-05-01
CBS News
Why's our monitor labelling this an incident or hazard?
The event involves AI systems (deepfake generation) used maliciously to create doctored explicit images and videos of a person, leading to sextortion scams. This constitutes a violation of rights and harm to the individual, fitting the definition of an AI Incident. The article details realized harm (emotional distress, identity weaponization, financial extortion attempts) caused by the AI system's use. The legislative response is complementary information but does not change the primary classification of the event as an AI Incident.
Thumbnail Image

'Frightening' surge in NZ sextortion with young people targeted

2025-05-04
NewstalkZB
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of AI software to create deepfake images that are used in sextortion threats, which have materially increased and caused harm to victims, including children. The AI system's outputs (deepfake images) are directly used to threaten and blackmail individuals, leading to psychological harm and violation of rights. This fits the definition of an AI Incident, as the AI system's use has directly led to harm to persons and communities. The involvement of organized crime groups using AI deepfakes further supports the classification as an incident rather than a mere hazard or complementary information.
Thumbnail Image

Former TV meteorologist battles AI sextortion scam

2025-05-01
CBS News
Why's our monitor labelling this an incident or hazard?
The article describes an AI system being used to manipulate images and videos of a person to create explicit content without consent, which is a direct violation of personal rights and causes harm to the individual. This constitutes an AI Incident as the AI system's use has directly led to harm through sextortion scams.