Teen Arrested for AI-Generated Explicit Images of Schoolgirls

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A teenager was arrested in Victoria, Australia, for using AI to create explicit images of 50 female students from Bacchus Marsh Grammar by manipulating their social media photos. The images were shared online, violating privacy and causing distress. Police are investigating, and the school is supporting affected students.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves the use of deepfake AI applications to generate explicit images of minors without consent, a clear violation of rights and harm (sexual exploitation and privacy infringement). The misuse directly led to the creation, dissemination, and legal consequences of these images, meeting the criteria for an AI Incident.[AI generated]
AI principles
Privacy & data governanceRespect of human rightsSafetyHuman wellbeingRobustness & digital securityAccountability

Industries
Education and trainingMedia, social platforms, and marketingDigital security

Affected stakeholders
Children

Harm types
Human or fundamental rightsPsychologicalReputational

AI system task:
Content generationRecognition/object detection

In other databases

Articles about this incident or hazard