AI-Generated Deepfake Faces Used in $25 Million Fraud via Video Call

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

In 2024, a Hong Kong financial worker at engineering firm Arup was deceived into transferring $25 million after participating in a video call where several participants, including a supposed CFO, were AI-generated deepfakes. The incident highlights the growing threat and financial harm caused by AI-generated identity fraud.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves the use of AI systems to generate deepfake faces that were used in a fraudulent video call, directly causing a $25 million financial loss. This is a clear example of harm to people (financial harm) caused by the use of AI. The article also discusses research on detecting such AI-generated faces, but the central event is the realized harm from AI misuse. Hence, it meets the criteria for an AI Incident rather than a hazard or complementary information.[AI generated]
AI principles
SafetyTransparency & explainability

Industries
Financial and insurance services

Affected stakeholders
Business

Harm types
Economic/Property

AI system task:
Content generation


Articles about this incident or hazard