AI-Generated Sexual Deepfakes of Minors Lead to Arrests in Japan

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A man in Japan used generative AI to create and post hundreds of sexually explicit deepfake images of real women, including minors, on social media. The images were made at the request of a high school student, both of whom were arrested. The incident caused significant harm and violated privacy and legal protections.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event describes the creation and dissemination of AI-generated deepfake images that are sexually explicit and involve real individuals, constituting a violation of rights and causing reputational harm. The AI system's use here is central to the harm, fulfilling the criteria for an AI Incident under violations of human rights and harm to communities. The arrest and legal actions confirm that harm has materialized, not just a potential risk.[AI generated]
AI principles
Privacy & data governanceRespect of human rights

Industries
Media, social platforms, and marketing

Affected stakeholders
WomenChildren

Harm types
Human or fundamental rightsPsychologicalReputational

AI system task:
Content generation


Articles about this incident or hazard