Florida Teens Arrested for Creating and Sharing AI-Generated Deepfake Nudes of Classmates

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Two Miami middle school boys, aged 13 and 14, were arrested and charged with felonies for using an AI application to create and share nonconsensual deepfake nude images of classmates aged 12-13. This marks the first known U.S. criminal case involving harm from AI-generated sexual imagery.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article describes a case where AI-generated deepfake nude images of minors were created and disseminated without consent, leading to arrests and charges under existing laws. The AI system's use directly led to harm to individuals (violation of rights and potential psychological harm), fulfilling the criteria for an AI Incident. The involvement of AI in generating harmful content and the resulting legal and social consequences confirm this classification.[AI generated]
AI principles
AccountabilityPrivacy & data governanceRespect of human rightsSafetyRobustness & digital security

Industries
Consumer services

Affected stakeholders
Children

Harm types
PsychologicalHuman or fundamental rightsReputational

Severity
AI incident

AI system task:
Content generation

In other databases

Articles about this incident or hazard

Thumbnail Image

Students arrested in the US for creating deepfake nudes of their classmates - Times of India

2024-03-09
The Times of India
Why's our monitor labelling this an incident or hazard?
The article describes a case where AI-generated deepfake nude images of minors were created and disseminated without consent, leading to arrests and charges under existing laws. The AI system's use directly led to harm to individuals (violation of rights and potential psychological harm), fulfilling the criteria for an AI Incident. The involvement of AI in generating harmful content and the resulting legal and social consequences confirm this classification.
Thumbnail Image

Florida teens arrested for creating "deepfake" AI nude images of classmates

2024-03-08
The Verge
Why's our monitor labelling this an incident or hazard?
The event involves the use of an AI system (an AI application generating deepfake images) whose use directly led to harm—specifically, violations of privacy and potentially other rights of the minors depicted. The harm is realized and has legal consequences, fitting the definition of an AI Incident.
Thumbnail Image

Florida Middle Schoolers Arrested for Allegedly Creating Deepfake Nudes of Classmates

2024-03-08
Wired
Why's our monitor labelling this an incident or hazard?
The event explicitly states that an AI application was used to generate fake nude images of minors without their consent, leading to psychological harm and legal consequences. This fits the definition of an AI Incident because the AI system's use directly caused harm to individuals (violation of rights and trauma) and breaches legal protections. The harm is realized and significant, not merely potential, and the event involves the development and use of an AI system leading to these harms.
Thumbnail Image

School students accused of generating nude images of classmates using AI, face legal action

2024-03-11
India Today
Why's our monitor labelling this an incident or hazard?
The event explicitly involves AI systems used to generate nude images of minors without consent, which is a direct violation of privacy and human rights. The harm has occurred as the images were created and distributed, leading to legal charges. The AI system's use is central to the incident, fulfilling the criteria for an AI Incident under violations of human rights and harm to individuals. The involvement of AI is clear, the harm is realized, and legal consequences are underway, confirming this classification.
Thumbnail Image

Middle Schoolers Arrested for Making AI Nudes of Classmates

2024-03-08
Futurism
Why's our monitor labelling this an incident or hazard?
The article explicitly states that an AI application was used to generate altered sexual depictions (deepfake nudes) of minors without their consent. This use of AI directly caused harm to the victims, including psychological trauma and violation of their rights. The involvement of AI in creating nonconsensual sexual imagery of minors is a clear case of harm caused by AI use, meeting the definition of an AI Incident. The legal charges and the described impact on victims further confirm the realized harm.
Thumbnail Image

Teens Arrested For Making Deepfake Nude Images of Classmates in First-Ever US Case

2024-03-12
PetaPixel
Why's our monitor labelling this an incident or hazard?
The event explicitly involves the use of an AI system to create deepfake nude images without consent, directly causing harm to the victims through violation of their rights and privacy. The criminal charges and arrests confirm that harm has materialized. This fits the definition of an AI Incident because the AI system's use directly led to violations of human rights and legal protections (harms under category (c)).
Thumbnail Image

Florida Middle Schoolers Arrested for Allegedly Creating Deepfake Nudes of Classmates

2024-03-08
Democratic Underground
Why's our monitor labelling this an incident or hazard?
The event explicitly involves AI-generated content (deepfake nude images) created and shared without consent, directly causing harm to the individuals depicted. This constitutes a violation of rights and is a criminal offense under applicable law. The AI system's use in generating these images is central to the harm, fulfilling the criteria for an AI Incident due to realized harm (violation of rights and harm to individuals).
Thumbnail Image

Florida middle-schoolers charged with making deepfake nudes of classmates

2024-03-09
Ars Technica
Why's our monitor labelling this an incident or hazard?
The event explicitly mentions the use of an AI application to generate fake nude images of minors without their consent, which constitutes a violation of rights and causes psychological harm to the victims. The involvement of AI in creating harmful content that directly impacts individuals' well-being and leads to criminal charges fits the definition of an AI Incident. The harm is realized and significant, involving violations of rights and harm to individuals, not merely a potential or future risk. Thus, the classification as AI Incident is appropriate.