AI Face-Swapping Scam Leads to Financial Loss in Nanjing

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A scammer used AI face-swapping technology to impersonate a woman's friend in a video call, convincing her to transfer 3,000 yuan. The realistic AI-generated video overcame her suspicions, resulting in financial loss. Police have launched an investigation, highlighting the risks of easily accessible AI face-swapping apps.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article describes a case where criminals likely used AI-based face-swapping technology to generate a short video impersonating the victim's acquaintance to deceive her into transferring money. The AI system's use directly led to financial harm (scam of 3000 yuan). This fits the definition of an AI Incident because the AI system's use directly caused harm to a person (financial loss) through fraudulent means.[AI generated]
AI principles
AccountabilityPrivacy & data governanceRespect of human rightsRobustness & digital securitySafetyTransparency & explainability

Industries
Digital security

Affected stakeholders
Consumers

Harm types
Economic/Property

AI system task:
Content generation


Articles about this incident or hazard