South Korean Civil Servant Fined for AI-Generated Deepfake of Colleague

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A Seoul district office employee used generative AI to create manipulated images of a female coworker, making it appear they were in a romantic relationship, and posted them on social media. The incident caused emotional distress and reputational harm to the victim. The perpetrator received a fine for sexual harassment and defamation.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event explicitly involves the use of a generative AI system to create manipulated content that caused direct harm to a person's dignity and reputation, fulfilling the criteria for an AI Incident. The harm includes serious sexual humiliation and defamation, which are violations of fundamental rights. The AI system's development and use directly led to this harm, and the legal consequences confirm the incident's severity. Therefore, this event is classified as an AI Incident.[AI generated]
AI principles
Respect of human rightsPrivacy & data governance
Industries
Government, security, and defence
Affected stakeholders
WorkersWomen
Harm types
PsychologicalReputational
AI system task:
Content generation

Articles about this incident or hazard