Chinese Student Prosecuted for AI-Generated Deepfake Sexual Exploitation

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A Chinese graduate student in Seoul used generative AI to create 1,141 deepfake sexual exploitation images and videos by synthesizing faces of seven lab colleagues. Prosecutors sought a three-year prison sentence. Victims reported trauma, and the defendant admitted guilt, with sentencing scheduled next month.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event describes the use of generative AI to produce deepfake sexual exploitation content, which directly violates the victims' rights and causes harm to their mental health. The AI system's use is central to the harm, fulfilling the criteria for an AI Incident under violations of human rights and harm to individuals. The legal proceedings and sentencing further confirm the recognition of harm caused by the AI-generated content.[AI generated]
AI principles
Respect of human rightsPrivacy & data governance
Industries
Education and training
Affected stakeholders
Workers
Harm types
PsychologicalReputationalHuman or fundamental rights
AI system task:
Content generation

Articles about this incident or hazard