Teen Arrested for AI-Generated Explicit Images of Schoolgirls

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A teenager was arrested in Victoria, Australia, for using AI to create explicit images of 50 female students from Bacchus Marsh Grammar by manipulating their social media photos. The images were shared online, violating privacy and causing distress. Police are investigating, and the school is supporting affected students.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves the use of deepfake AI applications to generate explicit images of minors without consent, a clear violation of rights and harm (sexual exploitation and privacy infringement). The misuse directly led to the creation, dissemination, and legal consequences of these images, meeting the criteria for an AI Incident.[AI generated]
AI principles
Privacy & data governanceRespect of human rightsSafetyHuman wellbeingRobustness & digital securityAccountability

Industries
Education and trainingMedia, social platforms, and marketingDigital security

Affected stakeholders
Children

Harm types
Human or fundamental rightsPsychologicalReputational

Severity
AI incident

AI system task:
Content generationRecognition/object detection

In other databases

Articles about this incident or hazard

Thumbnail Image

Experts' AI warning after schoolgirl photos targeted

2024-06-12
Daily Mail Online
Why's our monitor labelling this an incident or hazard?
The event involves the use of deepfake AI applications to generate explicit images of minors without consent, a clear violation of rights and harm (sexual exploitation and privacy infringement). The misuse directly led to the creation, dissemination, and legal consequences of these images, meeting the criteria for an AI Incident.
Thumbnail Image

Private school rocked by AI fake nude scandal

2024-06-11
Daily Mail Online
Why's our monitor labelling this an incident or hazard?
This event involves the malicious use of AI to create explicit fake images of minors without their consent, constituting a direct violation of privacy and human rights and resulting in psychological harm. The involvement of AI in generating and distributing these images makes this an AI Incident.
Thumbnail Image

Teenager questioned after explicit deepfakes of schoolgirls shared online

2024-06-13
CNN
Why's our monitor labelling this an incident or hazard?
This event involves the use of an AI system (deepfake generation) to produce and share explicit images of minors without consent, directly resulting in harm to the victims’ mental health and violating their rights. The harm has already occurred, making this an AI Incident.
Thumbnail Image

More respect needed to fight school porn deepfakes

2024-06-13
Daily Mail Online
Why's our monitor labelling this an incident or hazard?
A teenage boy used deepfake AI apps to manipulate and share dozens of girls’ photos into pornographic images without consent, leading to an arrest and harm to the victims. This is a direct AI-driven harm (violation of privacy and human rights) and therefore constitutes an AI Incident.
Thumbnail Image

Student AI deepfake images reflective of porn crisis

2024-06-12
Daily Mail Online
Why's our monitor labelling this an incident or hazard?
Deepfake image generation is an AI system whose misuse directly caused harm (privacy invasion, psychological trauma, sexual abuse) to minors. The incident is ongoing and involves realized harm, making it an AI Incident.
Thumbnail Image

Teenager sick after classmates 'mutilated' by AI

2024-06-12
Daily Mail Online
Why's our monitor labelling this an incident or hazard?
The article describes how an AI system was used to 'mutilate' private photos of minors into graphic fake nude images, leading to trauma, vomiting, and police action. This is a direct harm stemming from the malicious use of AI, fitting the definition of an AI Incident.
Thumbnail Image

Bacchus Marsh Grammar: Victorian premier blasts 'disgraceful' conduct after AI fake nude photo allegations

2024-06-12
Yahoo News UK
Why's our monitor labelling this an incident or hazard?
Generative AI was used to fabricate graphic nude images of about 50 female students without consent, directly harming their mental wellbeing, constituting a clear AI-driven incident involving non-consensual deepfake child sexual abuse imagery.
Thumbnail Image

Schoolboy arrested after allegedly posting fake explicit images of female students

2024-06-11
Yahoo News UK
Why's our monitor labelling this an incident or hazard?
The event describes the actual creation and distribution of AI-generated nude images (deepfakes) of real individuals without their consent, constituting realized harm—non-consensual intimate image abuse—directly linked to the use of an AI system.
Thumbnail Image

Deepfake nude photos of 50 Australian schoolgirls circulated online - VnExpress International

2024-06-13
VnExpress International – Latest news, business, travel and analysis from Vietnam
Why's our monitor labelling this an incident or hazard?
The creation and distribution of deepfake nude photos of minors involves generative AI. The misuse of this AI directly led to violations of the girls’ rights, emotional distress, and reputational harm. This is a realized harm, fitting the definition of an AI Incident.
Thumbnail Image

Bacchus Marsh Grammar school student arrested over fake porn images

2024-06-12
www.theepochtimes.com
Why's our monitor labelling this an incident or hazard?
The article describes a concrete incident in which an AI system (deepfake image generators) was misused to produce and distribute non-consensual sexual content of minors. This constitutes direct harm (psychological abuse, violation of privacy and rights) and thus qualifies as an AI Incident under the framework.
Thumbnail Image

50 students targeted in AI fake nude scandal

2024-06-11
News.com.au
Why's our monitor labelling this an incident or hazard?
The incident involves the malicious use of AI to generate fake nude images of real students and circulate them online, causing harm to individuals and violating their rights. Actual misuse and harm have occurred, making it an AI Incident.
Thumbnail Image

'Sickening': Parent reacts to fake nude images of students at Bacchus Marsh Grammar

2024-06-12
Australian Broadcasting Corporation
Why's our monitor labelling this an incident or hazard?
Explicit AI-generated nude images of around 50 underage students were produced and circulated, leading to psychological harm, police investigation, and arrest. The use and misuse of AI for creating these deepfakes directly caused harm, fitting the definition of an AI Incident.
Thumbnail Image

'It's appalling': Melbourne principal slams fake nude photos of female students believed to be generated using AI

2024-06-11
Australian Broadcasting Corporation
Why's our monitor labelling this an incident or hazard?
Faces of around 50 students were taken from social media and manipulated using AI to create nude images that were shared online. This non-consensual deepfake porn directly harmed the students’ rights and well-being, meeting the criteria for an AI Incident.
Thumbnail Image

Teenager arrested after explicit AI photos of 50 schoolgirls appear online

2024-06-12
The Independent
Why's our monitor labelling this an incident or hazard?
An AI system was explicitly used to doctor photos of schoolgirls into graphic sexual content and distribute them online, directly causing psychological harm, privacy and dignity violations. This constitutes an AI Incident under harms to persons and rights violations.
Thumbnail Image

Fifty Bacchus Marsh Grammar girls targeted with AI fake nudes

2024-06-11
The Sydney Morning Herald
Why's our monitor labelling this an incident or hazard?
The malicious use of AI to create and circulate fake nude images of minors constitutes a direct harm—violating the girls’ privacy and rights and causing emotional and reputational damage. This meets the definition of an AI Incident because the AI-generated content led to realized harm against individuals.
Thumbnail Image

Teen held in Australia as police investigate AI-generated nude images of 50 female students circulated online

2024-06-13
The New Indian Express
Why's our monitor labelling this an incident or hazard?
The event involves an AI system used to produce and distribute harmful non-consensual pornographic content, directly harming the students’ privacy, dignity, and mental health. This qualifies as an AI Incident because the misuse of generative AI has already materialized in rights violations and psychological injury.
Thumbnail Image

Dozens of private schoolgirls targeted in fake nude photo scandal

2024-06-11
7NEWS.com.au
Why's our monitor labelling this an incident or hazard?
An AI system was explicitly used to manipulate benign student photos into fake nude images, which were then circulated online. This constitutes direct harm—child abuse material, violation of privacy and rights, and serious legal and psychological consequences—and thus is an AI Incident.
Thumbnail Image

Teen arrested after girls targeted in AI photo scandal

2024-06-11
Perth Now
Why's our monitor labelling this an incident or hazard?
The event describes the actual use of an AI system to generate obscene, manipulated images of female students and circulate them online, resulting in real harm (privacy violation, psychological trauma, and sexual harassment). This meets the definition of an AI Incident, as the AI system’s misuse directly led to violation of rights and harm to individuals.
Thumbnail Image

Teenager arrested for 'misogynistic' AI-faked nudes

2024-06-12
Information Age
Why's our monitor labelling this an incident or hazard?
The article describes an AI system being used to generate fake nude images of students without their consent, which is a direct violation of their rights and causes psychological harm. The involvement of AI in creating these deepfakes is explicit, and the harm to the victims is realized and significant. The event meets the criteria for an AI Incident as it involves the use of AI leading directly to harm to individuals and violation of rights.
Thumbnail Image

Warning of 'porn crisis' in Aussie schools

2024-06-12
Otago Daily Times Online News
Why's our monitor labelling this an incident or hazard?
The event explicitly involves AI-generated deepfake pornography, which is a clear example of an AI system's use leading to direct harm to individuals through privacy violations and psychological trauma. The creation and distribution of manipulated explicit images without consent is a violation of human rights and causes harm to the affected community (students and their families). The harm is realized, as evidenced by the arrest and the distress caused to victims. Therefore, this qualifies as an AI Incident under the framework, as the AI system's use has directly led to significant harm.
Thumbnail Image

'Appalling': 50 schoolgirls targeted with AI fake nudes

2024-06-11
Otago Daily Times Online News
Why's our monitor labelling this an incident or hazard?
An AI system was used to manipulate images of pupils to create fake explicit photographs, which were then shared online. This constitutes a violation of the students' rights and causes harm to the individuals and the community. The harm has already occurred as the images were circulated, and a teenager was arrested in connection with the incident. Therefore, this qualifies as an AI Incident due to the direct harm caused by the AI-generated manipulated images.
Thumbnail Image

Student deepfakes reflective of school porn crisis

2024-06-12
AustralianAssociatedPress
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of online AI programs to create deepfake pornographic images of about 50 teenage girls, which were circulated online causing distress and harm. This constitutes a direct AI Incident as the AI system's use has led to violations of rights and significant harm to the affected individuals. The involvement of AI in generating manipulated images that are sexually explicit and non-consensual fits the definition of an AI Incident due to the realized harm to persons and communities.
Thumbnail Image

Police Arrests Teenage Boy Who Circulated AI-Generated Nude Images Of 50 High School Girls

2024-06-13
International Business Times UK
Why's our monitor labelling this an incident or hazard?
The event explicitly describes the creation and distribution of AI-generated nude images of minors, which is a direct violation of their rights and causes psychological harm. The AI system was used maliciously to generate manipulated images, leading to realized harm to individuals and the community. This fits the definition of an AI Incident because the AI system's use directly led to violations of human rights and harm to the affected individuals. The involvement of AI in generating the images is central to the harm caused, and the event is not merely a potential risk or complementary information but a realized incident.
Thumbnail Image

Male student arrested after deepfake pornographic images of 50 female students circulated online

2024-06-12
Women's Agenda
Why's our monitor labelling this an incident or hazard?
The event explicitly involves AI-generated deepfake images, which are a product of AI systems manipulating visual data to create realistic but fabricated content. The harm caused includes violations of privacy and human rights, psychological harm to the victims, and legal consequences under existing laws criminalizing such behavior. Since the AI system's use directly led to realized harm, this qualifies as an AI Incident under the OECD framework.
Thumbnail Image

Deepfake AI pornography is becoming more common - what can parents and schools do to prevent it?

2024-06-12
Tolerance
Why's our monitor labelling this an incident or hazard?
The article describes an AI system being used to create fake pornographic images of female students, which constitutes a violation of their rights and causes harm to the individuals and the community. The involvement of AI in generating these images directly led to harm, including reputational damage and psychological distress. Therefore, this qualifies as an AI Incident under the framework, as it involves harm to individuals and communities caused by the use of an AI system.
Thumbnail Image

Aussie Teen Held For Sharing Fake Explicit AI Photos Of 50 Schoolgirls

2024-06-12
SheThePeople
Why's our monitor labelling this an incident or hazard?
The event explicitly mentions the use of artificial intelligence to edit private photos of schoolgirls to create fake nude images, which were then shared online. This use of AI directly caused harm to the individuals involved, including psychological trauma and violation of privacy and rights. The involvement of AI in generating harmful content that leads to real-world harm fits the definition of an AI Incident, as it has directly led to harm to persons and violation of rights.
Thumbnail Image

Are schools doing enough to educate students about the dangers of AI as teachers fall victim to deepfake pornography?

2024-06-12
Australian Broadcasting Corporation
Why's our monitor labelling this an incident or hazard?
The article describes actual incidents in which AI systems were used to generate graphic, non-consensual deepfake pornography of real individuals (teachers and students). This misuse has directly harmed the victims’ mental and emotional well-being, violated their rights, and led to disciplinary and legal responses. Because AI misuse has led to concrete harm, this qualifies as an AI Incident.
Thumbnail Image

Vomit-inducing deepfake nudes show yet again that when misogyny intersects with AI and elitism, girls get hurt | Van Badham

2024-06-13
The Guardian
Why's our monitor labelling this an incident or hazard?
An AI system (deepfake/‘nudifying’ app) was explicitly used to scrape girls’ images and create sexualized content of minors, which was then distributed, leading to harm (trauma, privacy and rights violations, distribution of child sexual abuse material). This is a realized harm directly caused by AI misuse, so it qualifies as an AI Incident.
Thumbnail Image

How we've gone from a revival of 'make me a sandwich' jokes to a new era of AI 'revenge porn'

2024-06-14
Australian Broadcasting Corporation
Why's our monitor labelling this an incident or hazard?
The event involves the malicious use of an AI system to produce deepfake pornographic images of real students without consent, leading to concrete harm (psychological trauma, social and educational impacts). This is a realized harm directly stemming from AI misuse, meeting the criteria for an AI Incident.
Thumbnail Image

What to do if you, or someone you know, is targeted with deepfake porn or AI nudes

2024-06-12
The Conversation
Why's our monitor labelling this an incident or hazard?
Deepfake porn involves the use of AI to create and distribute non-consensual sexual imagery, causing actual harm to individuals (privacy violations, emotional distress) and breaching legal protections for minors and adults. This meets the definition of an AI Incident because the AI system’s misuse has directly led to serious harm.
Thumbnail Image

What to do if you or someone you know is targeted with deepfake porn or AI nudes

2024-06-12
Phys.org
Why's our monitor labelling this an incident or hazard?
The piece is primarily a how-to guide and overview of existing deepfake porn harms, legal recourse, and support mechanisms, rather than reporting a specific new incident, describing potential future risks, or announcing a remediation update to a prior incident. It serves to contextualize and support understanding and response within the broader AI ecosystem, fitting the definition of Complementary Information.
Thumbnail Image

Push for all-in response after deepfake porn shock

2024-06-15
AustralianAssociatedPress
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems to create deepfake pornography, which directly leads to harm to individuals (psychological trauma, violation of rights) and communities (gender-based violence). The sharing of these images constitutes a violation of rights and harm to health, fitting the definition of an AI Incident. The article also mentions ongoing and planned responses, but the primary focus is on the realized harm caused by the AI-generated content.
Thumbnail Image

Push for all-in response after deepfake porn shock | Canberra CityNews

2024-06-15
Canberra CityNews
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems to generate deepfake pornographic images without consent, which has directly led to harm to individuals (psychological harm, violation of rights) and communities (gender-based violence). The article describes actual incidents of harm (sharing of deepfake images of schoolgirls) and the resulting legal and policy responses. Therefore, this qualifies as an AI Incident because the AI system's use has directly led to violations of rights and harm to individuals and communities.
Thumbnail Image

MIL-Evening Report: What to do if you, or someone you know, is targeted with...

2024-06-12
foreignaffairs.co.nz
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of AI to generate fake sexually explicit images (deepfake porn) of individuals without their consent, including minors. This use of AI has directly led to harm such as violation of privacy, psychological distress, and breaches of legal protections against child sexual abuse material and non-consensual pornography. The involvement of AI in creating these images is central to the harm described. Therefore, this qualifies as an AI Incident under the framework, as the AI system's use has directly led to violations of rights and harm to individuals and communities.
Thumbnail Image

eSafety Commissioner calls for stronger Gen-AI safeguards in wake of deepfake arrest

2024-06-12
cyberdaily.au
Why's our monitor labelling this an incident or hazard?
The event describes an AI Incident because the creation and distribution of deepfake images using AI has directly led to harm to individuals (psychological distress, violation of rights) and breaches of legal protections against image-based abuse. The involvement of AI in generating synthetic abusive content is explicit, and the harm is realized, not just potential. Therefore, this qualifies as an AI Incident under the framework definitions.