Japan Sees Surge in AI-Generated Sexual Deepfake Images Targeting Minors

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Japanese police reported 123 cases of AI-generated sexual deepfake images of minors in the first half of 2024, more than double the previous year. Over 90% of victims were middle and high school students. Most perpetrators were classmates or peers, highlighting growing misuse of generative AI for child exploitation.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves the use of generative AI systems to create sexual deepfake images of minors, which constitutes a violation of human rights and causes harm to individuals and communities. The harm is realized and ongoing, as evidenced by the doubling of cases and the involvement of minors as victims. The AI system's role is pivotal in producing the harmful content, making this an AI Incident under the OECD framework.[AI generated]
AI principles
Respect of human rightsSafety
Industries
Other
Affected stakeholders
Children
Harm types
PsychologicalHuman or fundamental rights
AI system task:
Content generation

Articles about this incident or hazard