Teen Sentenced for Creating and Distributing Deepfake Sexual Exploitation Images of Teachers

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A teenager in Incheon, South Korea, used AI deepfake technology to create and distribute sexually exploitative images of teachers and peers, exposing victims' identities and causing significant psychological harm. The court sentenced the teen to up to two years in prison, highlighting the severe impact of AI misuse.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event describes the use of AI-based deepfake technology to produce and disseminate sexually exploitative content, which has directly harmed the victims' mental health and violated their rights. The AI system's use here is central to the harm caused, fulfilling the criteria for an AI Incident. The harm is realized, not just potential, and includes violations of human rights and harm to communities through psychological trauma and social harm.[AI generated]
AI principles
Privacy & data governanceRespect of human rights
Industries
Media, social platforms, and marketing
Affected stakeholders
WorkersChildren
Harm types
PsychologicalHuman or fundamental rightsReputational
AI system task:
Content generation

Articles about this incident or hazard