AI-Generated Deepfake Nude Image of Minor Distributed by Peers in Kilkis

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

In Kilkis, Greece, two 15-year-old boys used an AI application to create a deepfake nude image of a female classmate and distributed it to other minors. The incident led to psychological harm and legal action, highlighting the misuse of AI for non-consensual image manipulation and privacy violations.[AI generated]

Why's our monitor labelling this an incident or hazard?

The incident explicitly involves the use of AI to generate a harmful deepfake image, which was then shared, causing violation of personal rights and harm to the victim. The involvement of AI in creating the manipulated content and the resulting harm to the individual and community fits the definition of an AI Incident, as it directly led to violations of rights and harm.[AI generated]
AI principles
Privacy & data governanceRespect of human rights

Industries
Media, social platforms, and marketing

Affected stakeholders
Children

Harm types
PsychologicalHuman or fundamental rights

Severity
AI incident

AI system task:
Content generation


Articles about this incident or hazard