AI-Generated Nude Images of Women Distributed on Telegram in Novara

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A 40-year-old man in Novara, Italy, used AI tools to manipulate social media photos of women, creating non-consensual explicit images. These were distributed via Telegram channels, leading to police investigations, searches, and multiple arrests. The incident caused significant harm to victims' privacy and dignity.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event explicitly mentions the use of AI to modify images to create non-consensual sexually explicit content, which constitutes a violation of human rights and personal dignity. The distribution of these AI-manipulated images on a messaging platform caused direct harm to the victims. Therefore, this qualifies as an AI Incident because the AI system's use directly led to harm (violation of rights and personal harm).[AI generated]
AI principles
Respect of human rightsPrivacy & data governance

Industries
Media, social platforms, and marketing

Affected stakeholders
Women

Harm types
Human or fundamental rightsPsychological

AI system task:
Content generation


Articles about this incident or hazard