AI-Generated Influencers and Deepfakes Used in Social Media Shopping Scams

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Cybercriminals are leveraging AI-generated virtual influencers and deepfake technology on platforms like TikTok and Instagram to promote fake products and scams, leading to financial losses for consumers, especially among younger generations. These AI-driven schemes deceive users into paying for non-existent or counterfeit goods.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event clearly involves AI systems (AI-generated content, deepfake technology) used by cybercriminals to commit fraud, which has directly led to harm (financial loss) to consumers. The article details actual scams occurring, not just potential risks, thus constituting an AI Incident. The harm includes deception and financial loss, which fits under harm to persons or communities. The AI system's role is pivotal as it enables the creation of convincing fake influencers and product representations that facilitate the scams.[AI generated]
AI principles
Transparency & explainabilityAccountability

Industries
Media, social platforms, and marketingDigital security

Affected stakeholders
Consumers

Harm types
Economic/Property

Business function:
Marketing and advertisement

AI system task:
Content generation


Articles about this incident or hazard