South Korean University Students Use AI Deepfakes for Sexual Harassment and Exploitation

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A survey by the Korean Women's Policy Institute found that about 20% of male university students who created AI-generated deepfake images or videos did so for sexual gratification or to harass others. The study highlights significant gender differences in awareness and emotional impact of deepfake-related sexual crimes on campuses in South Korea.[AI generated]

Why's our monitor labelling this an incident or hazard?

Deepfake technology is an AI system that generates synthetic media. The article documents actual use of this AI system to create harmful content for sexual exploitation and harassment, which constitutes violations of human rights and harm to individuals and communities. The harms are realized, not hypothetical, and the AI system's role is pivotal in enabling these harms. Therefore, this event meets the criteria for an AI Incident.[AI generated]
AI principles
Respect of human rightsSafetyFairnessPrivacy & data governanceAccountabilityTransparency & explainability
Industries
Education and training
Affected stakeholders
Women
Harm types
PsychologicalReputationalHuman or fundamental rights
Severity
AI incident
AI system task:
Content generation

Articles about this incident or hazard