Deepfake AI Used to Create and Distribute Fake Pornographic Content in Brasília

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Two ex-employees in Brasília used AI deepfake technology to create and distribute fake pornographic videos and images of female colleagues. The manipulated content was shared via corporate emails and adult platforms, causing significant harm. Police launched an operation, seized devices, and are investigating the incident.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event explicitly describes the use of AI (deepfake technology) to create and disseminate manipulated pornographic content without consent, causing harm to individuals' rights and dignity. This fits the definition of an AI Incident because the AI system's use directly led to violations of human rights and harm to the victims. The involvement of AI in the creation and distribution of the harmful content is clear, and the harm is realized, not just potential.[AI generated]
AI principles
Privacy & data governanceRespect of human rights

Industries
Media, social platforms, and marketing

Affected stakeholders
Women

Harm types
PsychologicalReputationalHuman or fundamental rights

Severity
AI incident

AI system task:
Content generation


Articles about this incident or hazard