AI-Generated Influencer 'Emily Hart' Used to Scam MAGA Supporters

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A 22-year-old Indian medical student used Google's Gemini AI to create a fake influencer persona, 'Emily Hart,' targeting American MAGA supporters with AI-generated images and content. The account amassed thousands of followers and generated significant income through subscriptions and merchandise before being banned for fraudulent activity, causing financial and social harm.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves the use of generative AI systems to create a fake influencer persona that deceived users and generated income through fraudulent means. The AI system's outputs were central to the deception and monetization, directly causing harm to the users who were misled and financially exploited. The account was removed for fraudulent activity, confirming the harm occurred. This fits the definition of an AI Incident as the AI system's use directly led to harm (financial and trust-related) to groups of people.[AI generated]
AI principles
AccountabilityTransparency & explainability

Industries
Media, social platforms, and marketing

Affected stakeholders
Consumers

Harm types
Economic/PropertyPsychological

Business function:
Marketing and advertisement

AI system task:
Content generation


Articles about this incident or hazard