AI Deepfake Porn Scandal at US School

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A scandal involving AI-generated deepfake pornography has affected students at Lancaster Country Day School in Pennsylvania. The incident, which involved 347 images and videos impacting 60 victims, highlights the misuse of AI technology to create non-consensual explicit content, raising concerns about long-term impacts on victims' privacy and dignity.[AI generated]

Why's our monitor labelling this an incident or hazard?

Two teenagers used AI applications to generate hyperrealistic nude images of at least 60 underage victims and circulated them on Discord, constituting sexual abuse of children and possession of child pornography. The harm—harassment, bullying, mental health trauma, legal action—has already occurred and stems directly from misuse of an AI system.[AI generated]
AI principles
Privacy & data governanceRespect of human rightsHuman wellbeingSafetyAccountabilityRobustness & digital security
Industries
Education and trainingMedia, social platforms, and marketingDigital security
Affected stakeholders
Children
Harm types
Human or fundamental rightsPsychologicalReputational
AI system task:
Content generationRecognition/object detection

Articles about this incident or hazard