Creepy deepfake site digitally undresses thousands of everyday women
2021-08-11
Daily Mail Online
The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
A website using AI-powered deepfake technology has created and distributed realistic non-consensual nude images of thousands of women, leading to significant privacy violations, reputational harm, and mental distress. The tool has attracted millions of users, highlighting the dangers of AI misuse in generating synthetic, harmful content.[AI generated]
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of an AI system ('state of the art AI model' trained on millions of data points) to generate deepfake nude images without consent, targeting thousands of women. This use has directly caused harm by violating individuals' rights to privacy and dignity, and by contributing to violence against women. The harm is realized and ongoing, with millions of views and active dissemination. The AI system's role is pivotal as it enables the creation of realistic fake nudes from single images, which would be otherwise impossible or extremely difficult. Hence, this event meets the criteria for an AI Incident.[AI generated]