Brazilian Man Deceived by AI-Generated Virtual Influencer, Suffers Financial and Emotional Harm

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A 49-year-old Brazilian man, grieving his mother's death, was deceived by an AI-generated virtual influencer named "Jessica" with over 300,000 followers. Believing her invitations, he sold possessions and traveled 2,100 km to meet her, only to discover she was not real, resulting in financial loss and emotional distress.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event clearly involves an AI system generating a virtual character that was used to deceive a vulnerable individual, leading to realized harm (financial loss, emotional distress). The AI-generated persona was central to the incident, and the harm is direct and significant. Therefore, this qualifies as an AI Incident under the framework, as the AI system's use directly led to harm to a person and community (harm to property or community through deception).[AI generated]
AI principles
Transparency & explainabilityHuman wellbeing
Industries
Media, social platforms, and marketing
Affected stakeholders
Consumers
Harm types
Economic/PropertyPsychological
Business function:
Marketing and advertisement
AI system task:
Content generation

Articles about this incident or hazard