Meta's AI-Generated Deepfake Ads Enable Widespread Scams Targeting Vulnerable Users

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Meta's AI-powered ad systems have enabled deepfake scam ads using public figures' faces and voices, including Mark Cuban, to promote fraudulent products and investment schemes. These AI-generated ads have led to significant financial harm, especially among older Americans, with Meta reportedly earning billions in revenue from such scams despite internal awareness.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves AI systems explicitly: deepfake technology generating fraudulent ads using AI copies of individuals' faces and voices, and Meta's automated ad approval systems that allow scam ads to run unless they meet a high threshold of suspicion. The use of these AI systems directly leads to harm—financial fraud targeting users, including vulnerable elderly people, which is a violation of rights and causes significant harm to individuals and communities. The internal documents confirm the scale of the harm and the company's tolerance of these AI-enabled scams. Therefore, this is an AI Incident as the AI system's use has directly led to realized harm.[AI generated]
AI principles
AccountabilityTransparency & explainability

Industries
Media, social platforms, and marketing

Affected stakeholders
Consumers

Harm types
Economic/Property

Business function:
Marketing and advertisement

AI system task:
Content generationOrganisation/recommenders


Articles about this incident or hazard