YouTube removes over 1,000 AI-generated celebrity deepfake scam ads

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Google-owned YouTube has removed over 1,000 AI-generated deepfake scam videos featuring celebrities like Taylor Swift, Steve Harvey, and Joe Rogan promoting Medicare fraud. The ads, viewed nearly 200 million times, emerged from an advertising ring uncovered by 404 Media. Additionally, non-consensual deepfake porn of Taylor Swift reached 45 million views on X.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves AI systems generating deepfake videos of celebrities used to deceive users into scams, which is a direct harm to individuals (harm to communities and individuals through fraud). The AI-generated content was actively used and viewed by millions, causing realized harm. YouTube's removal of these videos is a response to an AI Incident involving misuse of AI-generated content for fraudulent purposes.[AI generated]
AI principles
AccountabilityPrivacy & data governanceRespect of human rightsRobustness & digital securitySafetyTransparency & explainabilityHuman wellbeing

Industries
Media, social platforms, and marketingHealthcare, drugs, and biotechnologyDigital securityGovernment, security, and defence

Affected stakeholders
ConsumersGeneral publicOther

Harm types
Economic/PropertyReputationalHuman or fundamental rightsPsychologicalPublic interest

Severity
AI incident

Business function:
Marketing and advertisement

AI system task:
Content generationOrganisation/recommenders

In other databases

Articles about this incident or hazard