AI-Generated Fake Images of Celebrity Lead to Legal Action in South Korea

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

AI-generated synthetic images falsely depicting Girls' Generation member and actress Yoona, including manipulated pregnancy photos, were widely circulated online without her consent. SM Entertainment responded by filing criminal complaints, citing defamation and rights violations, and announced a strict legal stance against further distribution or creation of such content.[AI generated]

Why's our monitor labelling this an incident or hazard?

An AI system was explicitly used to generate synthetic images that falsely depict a person, leading to reputational and privacy harm. The unauthorized use of AI to create and spread false images constitutes a violation of rights and defamation, which fits the definition of an AI Incident under violations of human rights or breach of obligations protecting fundamental rights. The harm is realized and ongoing, as the images have been widely disseminated and legal action is underway. Therefore, this event qualifies as an AI Incident.[AI generated]
AI principles
Privacy & data governanceRespect of human rights

Industries
Media, social platforms, and marketing

Affected stakeholders
Women

Harm types
ReputationalHuman or fundamental rights

AI system task:
Content generation


Articles about this incident or hazard