AI-Generated Female Avatars Used for Political Manipulation and Adult Content Sales in Brazil

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

AI-generated images and videos of non-existent women were used in Brazil to create fake social media profiles supporting political figures Flávio Bolsonaro and Lula. These profiles attracted millions of followers, spread political misinformation, and redirected users to paid adult content, exploiting and deceiving the public.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves AI systems generating realistic fake human images and videos used in political contexts to mislead and manipulate public opinion, which is a direct harm to communities and political processes. The AI-generated profiles also facilitate the sale of adult content through deceptive means, exploiting users and violating platform rules. The lack of disclosure about AI-generated content further compounds the harm. These factors meet the criteria for an AI Incident as the AI system's use has directly led to significant harms including misinformation, manipulation, and exploitation. The presence of AI is explicit and central to the harm, and the harm is realized, not merely potential.[AI generated]
AI principles
Transparency & explainabilityDemocracy & human autonomy

Industries
Media, social platforms, and marketingConsumer services

Affected stakeholders
General publicConsumers

Harm types
Economic/PropertyPublic interest

Business function:
Marketing and advertisement

AI system task:
Content generation


Articles about this incident or hazard