Man Indicted in Brazil for Creating and Sharing Deepfake Pornography Using AI

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

In Ponta Grossa, Brazil, a man was indicted after using AI deepfake technology to create and distribute fake pornographic images of a woman as an act of revenge for being ignored online. The manipulated images, featuring the victim's face on nude bodies, were shared on adult platforms, causing significant harm to her privacy and dignity.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event explicitly involves the use of AI (deepfake) to create false pornographic content targeting a specific individual, which is a clear violation of rights and constitutes harm. The AI system's use was malicious and directly caused harm to the victim's privacy and dignity. The police investigation confirmed the link between the suspect and the AI-generated content, and the content was removed following the investigation. Therefore, this is an AI Incident due to realized harm caused by the AI system's use.[AI generated]
AI principles
Privacy & data governanceRespect of human rights

Industries
Media, social platforms, and marketing

Affected stakeholders
Women

Harm types
PsychologicalReputationalHuman or fundamental rights

AI system task:
Content generation


Articles about this incident or hazard