AI-Generated Fake Nude Images of Minors Circulated in Alcalá de Henares

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

In Alcalá de Henares, AI was used to manipulate images of minors to create fake nude photos, which were then shared on social media. Police identified the perpetrator, a minor, and referred the case to the courts. The incident caused significant harm to the victims and their families.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event explicitly mentions the use of an AI program to create manipulated nude images of minors, which were then spread on social media, causing harm to the victims and their families. This is a clear violation of rights and a form of harm to communities. The AI system's use directly led to this harm, fulfilling the criteria for an AI Incident.[AI generated]
AI principles
Privacy & data governanceRespect of human rightsSafetyAccountabilityRobustness & digital securityTransparency & explainabilityHuman wellbeing

Industries
Media, social platforms, and marketingGovernment, security, and defenceDigital security

Affected stakeholders
ChildrenGeneral public

Harm types
Human or fundamental rightsPsychologicalReputational

Severity
AI incident

AI system task:
Content generation


Articles about this incident or hazard

Thumbnail Image

Los desnudos de menores hechos con Inteligencia Artificial se expanden a Alcalá de Henares

2023-09-22
Diario Crítico
Why's our monitor labelling this an incident or hazard?
The event explicitly mentions the use of an AI program to create manipulated nude images of minors, which were then spread on social media, causing harm to the victims and their families. This is a clear violation of rights and a form of harm to communities. The AI system's use directly led to this harm, fulfilling the criteria for an AI Incident.
Thumbnail Image

Nuevo caso de niñas 'desnudas' por una IA en Alcalá de Henares: sus fotos siguen en las redes

2023-09-22
El Español
Why's our monitor labelling this an incident or hazard?
The article explicitly states that an AI program was used to alter photos of minors to appear nude, which were then shared on social media, causing harm to the victims. This constitutes a violation of rights and harm to the community, fitting the definition of an AI Incident. The involvement of AI in the creation of manipulated images and the resulting harm to individuals and their families confirms this classification.
Thumbnail Image

Denunciados en Alcalá de Henares dos casos de fotografías de niñas 'desnudadas' con Inteligencia Artificial

2023-09-22
eldiario.es
Why's our monitor labelling this an incident or hazard?
The event explicitly mentions the use of AI (deepfake technology) to create hyperrealistic manipulated images of minors, constituting a violation of rights and a form of violence. The dissemination of these images has caused harm to the victims and their families. The AI system's use is central to the harm, fulfilling the criteria for an AI Incident under violations of human rights and harm to communities. Therefore, this is classified as an AI Incident.
Thumbnail Image

Más fotos de niñas "desnudadas" con inteligencia artificial, esta vez en Alcalá de Henares

2023-09-22
La Voz de Galicia
Why's our monitor labelling this an incident or hazard?
The event explicitly mentions the use of an AI program to alter images of minors to appear nude, which constitutes a violation of rights and harm to the individuals involved. The dissemination of such manipulated images causes significant harm to the victims and their communities. The AI system's use directly led to this harm, fulfilling the criteria for an AI Incident under the framework. Therefore, this event is classified as an AI Incident.
Thumbnail Image

Denuncian en Alcalá dos fotos de niñas 'desnudadas' con Inteligencia...

2023-09-22
europa press
Why's our monitor labelling this an incident or hazard?
The event explicitly mentions the use of an AI program to alter photos of children to appear nude, which constitutes a violation of rights and harm to the individuals involved. The AI system's use in creating these manipulated images directly caused harm, fulfilling the criteria for an AI Incident. The dissemination of these images on social media further compounds the harm to the victims and their communities. Therefore, this event qualifies as an AI Incident due to realized harm linked to AI use.
Thumbnail Image

Dávila subraya la importancia del buen uso de las tecnologías en...

2023-09-25
europa press
Why's our monitor labelling this an incident or hazard?
The event explicitly involves the use of an AI system to manipulate images, resulting in the creation and dissemination of harmful content involving minors. This has caused direct harm to the victims, including violations of their rights and psychological harm. The AI system's use is central to the incident, fulfilling the criteria for an AI Incident as defined by the framework. The ongoing investigation and legal proceedings further confirm the materialization of harm rather than a potential risk.
Thumbnail Image

Denuncian otros dos casos de menores desnudadas con Inteligencia Artificial en Alcalá (Madrid)

2023-09-22
La Razón
Why's our monitor labelling this an incident or hazard?
The article explicitly states that an AI program was used to generate nude images of minors, which were then shared on social media, causing harm to the victims and their families. This is a clear violation of human rights and privacy, fulfilling the criteria for harm under the AI Incident definition. The AI system's use directly led to the harm, and the event involves the malicious use of AI-generated content. Hence, it is classified as an AI Incident.
Thumbnail Image

Denuncian dos nuevos casos de fotografías de niñas desnudadas con Inteligencia Artificial

2023-09-22
Antena3
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of an AI program to create manipulated nude images of minors, which were shared on social media, causing harm to the victims. This constitutes a violation of rights and harm to individuals, fitting the definition of an AI Incident. The AI system's use in image manipulation and dissemination directly led to these harms, and legal authorities are involved, confirming the seriousness of the incident.
Thumbnail Image

Denuncian un nuevo caso de falsos desnudos de niñas creados con IA en Alcalá de Henares

2023-09-22
Público.es
Why's our monitor labelling this an incident or hazard?
The event explicitly mentions the use of an AI program to generate false nude images of minors, which were then shared on social media. This use of AI directly caused harm to the victims, including violation of their rights and potential psychological harm. The involvement of AI in creating manipulated images that led to legal action and police investigation fits the definition of an AI Incident, as the AI system's use directly led to harm to persons and communities.
Thumbnail Image

Dos nuevas denuncias por fotos de niñas 'desnudadas' con Inteligencia Artificial, ahora en Madrid

2023-09-22
Vozpópuli
Why's our monitor labelling this an incident or hazard?
The event explicitly mentions the use of an AI program to alter images of minors in a harmful way, constituting a violation of rights and harm to the affected individuals. The dissemination of these AI-manipulated images on social media has caused direct harm, fulfilling the criteria for an AI Incident. The involvement of law enforcement and ongoing investigations further confirm the materialization of harm linked to the AI system's use.
Thumbnail Image

Tercer caso de niñas 'desnudadas' con Inteligencia Artificial: Ahora en Alcalá de Henares

2023-09-22
Diario de Sevilla
Why's our monitor labelling this an incident or hazard?
The event explicitly mentions the use of an AI program to alter images of minors to create fake nude photos, which were then shared on social media. This constitutes a direct harm to the individuals involved, including violations of their rights and psychological harm. The AI system's use in generating manipulated images that caused harm fits the definition of an AI Incident, as the harm is realized and directly linked to the AI system's misuse.
Thumbnail Image

Tercer caso de niñas 'desnudadas' con Inteligencia Artificial: Ahora en Alcalá de Henares

2023-09-22
Diario de Cádiz
Why's our monitor labelling this an incident or hazard?
The article explicitly states that an AI program was used to alter photos of girls to make them appear nude, which were then shared on social media. This manipulation caused harm to the victims and their families, leading to police investigations and legal actions. The AI system's use directly caused violations of privacy and potential psychological harm, fitting the definition of an AI Incident due to harm to persons and violation of rights. Therefore, this event qualifies as an AI Incident.
Thumbnail Image

Denuncian en Alcalá la difusión de fotos de dos niñas 'desnudadas' con Inteligencia Artificial

2023-09-22
Deia
Why's our monitor labelling this an incident or hazard?
The event describes the creation and distribution of AI-manipulated nude images of children, which constitutes a violation of human rights and causes harm to the individuals involved. The AI system's use in generating these images is central to the incident, fulfilling the criteria for an AI Incident due to direct harm caused by the AI system's outputs.
Thumbnail Image

Dos denuncias en Alcalá por imágenes de falsos desnudos de niñas con IA

2023-09-22
Madridiario
Why's our monitor labelling this an incident or hazard?
The event explicitly mentions the use of AI to create manipulated images of minors, which were then shared on social media, causing harm to the victims and their families. The AI system's use directly led to violations of rights and harm to the affected individuals. The presence of harm is realized, not just potential, as the images were disseminated and complaints filed. Therefore, this qualifies as an AI Incident under the definitions provided.
Thumbnail Image

Denuncian en Alcalá fotos de niñas 'desnudadas' con inteligencia artificial

2023-09-23
La Opinion A Coruña - laopinioncoruna.es
Why's our monitor labelling this an incident or hazard?
The event explicitly mentions the use of a computer program (AI) to manipulate images of minors to create fake nude photos, which were then disseminated on social media. This constitutes a violation of human rights and harm to the affected individuals and communities. The involvement of AI in generating these images and the resulting harm meets the criteria for an AI Incident, as the AI system's use has directly led to significant harm and legal action.