Non-Consensual AI-Generated Sexual Images Created at Perth Bar

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

In Perth, Australia, a group of men secretly photographed a woman, Jade Helen, and her friend at a bar, then used AI to generate non-consensual, sexualized images of them. The men showed the manipulated images to the victims, causing distress and violating their privacy and dignity.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event explicitly describes the use of an AI program to alter a photo into sexualized content without consent, which is a direct violation of the woman's rights and causes harm to her dignity and privacy. The AI system's use directly led to this harm, fulfilling the criteria for an AI Incident under violations of human rights and breach of consent. The incident is not merely a potential risk but a realized harm, and the AI system's role is pivotal in creating the sexualized images. Hence, the classification as AI Incident is appropriate.[AI generated]
AI principles
Privacy & data governanceRespect of human rights

Industries
General or personal use

Affected stakeholders
Women

Harm types
PsychologicalHuman or fundamental rights

AI system task:
Content generation


Articles about this incident or hazard