AI-Generated Deepfake Scam Ads Target Seniors on Meta Platforms

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Scammers used AI-generated deepfake videos of U.S. politicians to promote fraudulent government benefits in political ads on Meta's Facebook and Instagram. These ads, targeting mainly seniors, led to financial harm and widespread misinformation, exploiting weak content moderation and reaching tens of thousands of users.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly mentions the use of AI to create deepfake videos in political ads that promote false government benefits, leading to financial and informational harm to users. The harm is realized and ongoing, as fraudulent advertisers have spent millions and reached tens of thousands of users. The AI system's role is pivotal in generating convincing fake content that facilitates the scam. Therefore, this qualifies as an AI Incident due to direct harm caused by AI-generated misinformation and fraud.[AI generated]
AI principles
AccountabilityFairnessRobustness & digital securitySafetyTransparency & explainabilityDemocracy & human autonomy

Industries
Media, social platforms, and marketing

Affected stakeholders
ConsumersGeneral public

Harm types
Economic/PropertyPublic interest

Severity
AI incident

Business function:
Marketing and advertisement

AI system task:
Content generation

In other databases

Articles about this incident or hazard