Spanish Police Investigate AI-Generated Fake Nude Images of Minors

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Spanish police are investigating five youths for using AI to create and distribute fake nude images of 20 minors in Seville, causing significant emotional and social harm. The images, difficult to distinguish from real ones, were shared on social media. The suspects face potential charges for child pornography and privacy violations.[AI generated]

Why's our monitor labelling this an incident or hazard?

AI-powered deepfake tools were explicitly used to create non-consensual pornographic images and videos of minors, resulting in actual criminal investigations, emotional trauma to victims, and violations of rights. This describes materialized harm directly resulting from AI misuse.[AI generated]
AI principles
Privacy & data governanceRespect of human rightsSafetyTransparency & explainabilityAccountabilityRobustness & digital securityHuman wellbeing

Industries
Media, social platforms, and marketingDigital securityGovernment, security, and defence

Affected stakeholders
Children

Harm types
PsychologicalReputationalHuman or fundamental rights

Severity
AI incident

AI system task:
Content generation


Articles about this incident or hazard

Thumbnail Image

El caso Kaylin Hayman: la lucha contra el porno 'fake' de la Inteligencia Artificial

2024-08-05
EL MUNDO
Why's our monitor labelling this an incident or hazard?
AI-powered deepfake tools were explicitly used to create non-consensual pornographic images and videos of minors, resulting in actual criminal investigations, emotional trauma to victims, and violations of rights. This describes materialized harm directly resulting from AI misuse.
Thumbnail Image

Investigan a cinco jóvenes por crear y difundir imágenes de menores a las que desnudaron con inteligencia artificial

2024-08-05
El Espa├▒ol
Why's our monitor labelling this an incident or hazard?
An AI system was explicitly used to generate and alter images of minors to appear nude, which were then disseminated, directly causing harm (sexual exploitation, emotional trauma) and violating the victims’ rights. This is a realized harm from malicious AI use fitting the definition of an AI Incident.
Thumbnail Image

INTELIGENCIA ARTIFICIAL MENORES

2024-08-05
Diario Sport
Why's our monitor labelling this an incident or hazard?
This is a clear case where an AI system was used to produce child sexual exploitation material, causing direct harm and violating the victims’ rights. The misuse of AI to create and disseminate non-consensual sexual content of minors is a concrete incident.
Thumbnail Image

Investigados cinco jóvenes por crear y difundir imágenes de 20 menores desnudadas por inteligencia artificial

2024-08-05
20 minutos
Why's our monitor labelling this an incident or hazard?
An AI system was explicitly used to manipulate photographs of minors into pornographic content. The creation and dissemination of these images led directly to violations of the victims’ rights and severe emotional harm, meeting the criteria for an AI Incident (violation of human rights and harm to individuals).
Thumbnail Image

La policía española investiga falsos desnudos de menores generados por inteligencia artificial

2024-08-05
France 24
Why's our monitor labelling this an incident or hazard?
The article describes an active misuse of AI (deepfake generation) to create and distribute non-consensual, pornographic images of underage girls, directly causing emotional and social harm and violating privacy and child protection laws. This constitutes an AI Incident.
Thumbnail Image

Cinco jóvenes son investigados por difundir imágenes de menores desnudas creadas por la Inteligencia Artificial

2024-08-05
El Confidencial
Why's our monitor labelling this an incident or hazard?
The case involves deliberate use of an AI system to generate sexualized images of minors and distribute them, resulting in real harm (emotional and social damage) and legal violations (child pornography). This is a direct harm caused by the misuse of an AI system, fitting the definition of an AI Incident.
Thumbnail Image

La Guardia Civil investiga a cinco j├│venes de Sevilla por crear y difundir fotos de 20 ni├▒as desnudas por inteligencia artificial

2024-08-05
eldiario.es
Why's our monitor labelling this an incident or hazard?
An AI system was employed to produce manipulated nude images of minors, constituting a direct violation of the victims’ rights and resulting in concrete emotional and social harm. This is a realized harm scenario where AI played a pivotal role in generating illegal and harmful content.
Thumbnail Image

Cinco investigados en Sevilla por difundir imágenes de chicas menores desnudas creadas con IA

2024-08-05
La Voz de Galicia
Why's our monitor labelling this an incident or hazard?
The event describes the actual use of AI to create manipulated naked images of minors and their distribution via messaging apps, resulting in concrete emotional and social harm and child pornography offenses. This constitutes an AI Incident because the misuse of AI led directly to violations of rights and significant harm to victims.
Thumbnail Image

Investigados en Sevilla cinco jóvenes por crear y difundir imágenes...

2024-08-05
europa press
Why's our monitor labelling this an incident or hazard?
This case involves direct use of an AI system to produce and share manipulated images of minors for pornographic purposes, resulting in realized harm (child sexual exploitation, psychological and social damage). Therefore, it is an AI Incident.
Thumbnail Image

Cinco jóvenes investigados por crear y difundir imágenes de menores...

2024-08-05
europa press
Why's our monitor labelling this an incident or hazard?
The event describes the direct misuse of an AI system to create and disseminate pornographic content involving minors, resulting in actual harm and violation of human rights (child pornography and privacy breaches). This meets the criteria for an AI Incident.
Thumbnail Image

Los delitos por manipular con inteligencia artificial: ¿a qué penas se enfrentan los investigados?

2024-08-05
LaSexta
Why's our monitor labelling this an incident or hazard?
This is a realized harm: the use of an AI system to produce and disseminate child pornography constitutes a violation of minors’ rights and criminal law. The AI-generated images directly led to legal action, so it meets the criteria for an AI Incident.
Thumbnail Image

Cinco investigados por difundir fotos de chicas menores desnudas con IA

2024-08-05
infobae
Why's our monitor labelling this an incident or hazard?
The Guardia Civil is investigating five individuals for using AI software to generate and share nude images of 20 underage girls. This involved malicious use of an AI system, directly causing emotional, social, and legal harm to the victims and violating their rights (pornography of minors, privacy breaches). Since the AI’s misuse has directly led to significant harm, this qualifies as an AI Incident.
Thumbnail Image

Cinco jóvenes investigados por crear imágenes de 20 menores desnudas con Inteligencia Artificial

2024-08-05
MARCA
Why's our monitor labelling this an incident or hazard?
Five individuals used AI software to generate false nude images of 20 underage girls and circulated them via messaging and social media. This constitutes a direct violation of fundamental rights (child pornography, privacy breach) and has resulted in tangible emotional harm and criminal investigations. The AI system’s use directly led to these harms, making it an AI Incident.
Thumbnail Image

Investigados 5 j├│venes en Sevilla por la difusi├│n de fotos desnudas de 20 menores manipuladas con IA

2024-08-05
Antena3
Why's our monitor labelling this an incident or hazard?
The event describes the actual creation and distribution of AI-manipulated sexual images of minors, leading to emotional and social harm and child pornography investigations. An AI system’s use directly led to real harm (violation of rights, emotional damage), making this an AI Incident.
Thumbnail Image

Investigados cinco jóvenes por crear imágenes con inteligencia artificial de 20 menores desnudas para difundirlas

2024-08-05
infobae
Why's our monitor labelling this an incident or hazard?
An AI system was explicitly used to create illicit images of minors, leading to violations of child-pornography and privacy laws, as well as significant emotional and social harm. The development and use of AI for generating these images directly contributed to the offense, making this an AI Incident.
Thumbnail Image

El peligro de la difusi├│n de fotos con IA: "Ha llevado a chicas al suicidio"

2024-08-06
Antena3
Why's our monitor labelling this an incident or hazard?
The described case involves the use of an AI software tool to alter minors’ photos into realistic nude images, then distributing them—constituting direct harm (psychological injury, violation of minors’ rights) caused by an AI system’s outputs. Harms have already materialized (suicides, psychological trauma, legal actions), fitting the definition of an AI Incident.
Thumbnail Image

Policía española investiga falsos desnudos de menores generados por inteligencia artificial

2024-08-05
T13 (teletrece)
Why's our monitor labelling this an incident or hazard?
This is a direct misuse of generative AI: suspects used AI to produce and circulate non-consensual, illegal sexual imagery of minors. The AI system’s outputs have already caused real emotional and social harm and legal violations, fitting the definition of an AI Incident.
Thumbnail Image

Espa├▒a investiga desnudos de menores creados por inteligencia artificial - 24 Horas

2024-08-05
24 Horas
Why's our monitor labelling this an incident or hazard?
The event describes the actual misuse of an AI system to create non-consensual, sexualized deepfake images of minors—constituting child pornography and privacy violations—which has directly led to emotional and social harm. This qualifies as an AI incident under the definitions of realized harm involving an AI system.
Thumbnail Image

Sumar pide explicaciones a Interior por el acuerdo firmado por un sindicato policial y el 'Club Desokupa'

2024-08-05
Diario Siglo XXI
Why's our monitor labelling this an incident or hazard?
The event involves the use of an AI system (image manipulation software using AI) to create and distribute pornographic images of minors, which constitutes a violation of human rights and causes significant harm to the victims. The harm has already occurred, and the AI system's use is central to the incident. Therefore, this qualifies as an AI Incident under the framework, specifically under harm category (c) violations of human rights and (a) harm to health (emotional/social).
Thumbnail Image

Cinco jóvenes investigados por difundir fotos de 20 menores desnudas creadas con IA

2024-08-06
Confidencial Autonómico
Why's our monitor labelling this an incident or hazard?
The article explicitly states that AI was used to create manipulated nude images of minors, which were then distributed. This constitutes a violation of rights (privacy and child protection laws) and is a clear harm caused by the use of an AI system. The involvement of AI in generating the images and the resulting legal investigation and harm to the victims qualifies this event as an AI Incident under the framework.
Thumbnail Image

España investiga a cinco jóvenes por 'desnudar' con IA a una veintena de menores de edad

2024-08-05
eju.tv
Why's our monitor labelling this an incident or hazard?
The article describes the use of AI to manipulate images of minors to create fake nude photos, which were then shared, causing harm to the victims and violating laws against child pornography and privacy. The AI system's use directly led to the harm, fulfilling the criteria for an AI Incident involving violations of human rights and harm to individuals. Therefore, this event qualifies as an AI Incident.
Thumbnail Image

Policía española investiga falsos desnudos de menores generados por inteligencia artificial Ensegundos República Dominicana

2024-08-05
José Peguero
Why's our monitor labelling this an incident or hazard?
The article explicitly describes AI-generated deepfake images of minors being used maliciously, leading to emotional and social harm, and legal violations. The AI system's use in generating these images directly led to harm, fulfilling the criteria for an AI Incident under violations of rights and harm to individuals. Therefore, this event is classified as an AI Incident.
Thumbnail Image

España: investigan a cinco jóvenes por haber generado con inteligencia artificial imágenes de desnudos de 20 menores de edad y difundirlas

2024-08-05
Teledoce.com
Why's our monitor labelling this an incident or hazard?
The article explicitly states that AI was used to generate manipulated nude images of minors, which were then spread online, causing significant emotional and social harm. This meets the criteria for an AI Incident because the AI system's use directly led to harm (emotional and social) and violations of privacy and legal protections. The involvement of AI in creating deepfake pornography of minors is a clear case of harm caused by AI misuse.
Thumbnail Image

Investigan a cinco jóvenes en Sevilla por crear y difundir imágenes pornográficas de menores modificadas con IA

2024-08-05
El Correo de Andalucía
Why's our monitor labelling this an incident or hazard?
The article explicitly states that AI was used to alter images of minors to create pornographic content, which was then spread, causing emotional and social harm. This constitutes a violation of human rights and a breach of legal protections for minors. The AI system's use directly led to these harms, qualifying this event as an AI Incident under the framework.
Thumbnail Image

La Guardia Civil detecta un nuevo escándalo de menores 'desnudadas' con IA en España: cinco jóvenes, investigados en Sevilla

2024-08-05
Business Insider
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of AI tools to create fake nude images of minors (deepfakes), which were then disseminated, causing emotional and social harm. This constitutes a violation of rights and harm to individuals. The involvement of AI in generating the harmful content and its distribution directly led to these harms. Therefore, this event qualifies as an AI Incident under the framework definitions.
Thumbnail Image

Inteligencia artificial y pornografía infantil: cómo se está usando la IA para crear contenidos sexuales de menores y qué dice la ley - Maldita.es

2024-08-06
Maldita.es — Periodismo para que no te la cuelen
Why's our monitor labelling this an incident or hazard?
The article explicitly describes the use of AI systems to create non-consensual, sexually explicit images of minors, which are considered child pornography under the law. These AI-generated images have been disseminated, causing direct harm to the victims' rights, dignity, and well-being. The involvement of AI in producing and spreading illegal content that harms individuals and violates laws fits the definition of an AI Incident, as the AI system's use has directly led to significant harm and legal violations. The article also mentions ongoing investigations and legal responses, but the primary focus is on the realized harm caused by AI-generated child sexual content.
Thumbnail Image

الشرطة الإسبانية تحقق في استخدام الذكاء الاصطناعي لإنتاج صور إباحية لقاصرات

2024-08-05
مغرس
Why's our monitor labelling this an incident or hazard?
The use of AI (deepfake technology) to create and disseminate pornographic images of minors constitutes a direct violation of human rights and privacy laws, causing harm to the victims. The AI system's use here directly led to harm (psychological and social) to individuals, fulfilling the criteria for an AI Incident under violations of human rights and harm to communities.
Thumbnail Image

الشرطة الإسبانية تحقق بنشر صور "إباحية" لفتيات قاصرات - شفق نيوز

2024-08-05
Shafaq News
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of AI (deepfake technology) to create manipulated pornographic images of minors, which were then distributed online. This use of AI directly led to harm to the victims' psychological and social well-being, constituting a violation of rights and harm to individuals. Therefore, this qualifies as an AI Incident due to the direct harm caused by the AI system's misuse.
Thumbnail Image

Espagne: cinq jeunes mis en cause pour des photos dénudées de jeunes filles générées par IA

2024-08-05
BFMTV
Why's our monitor labelling this an incident or hazard?
The incident involves the malicious use of an AI system to create and disseminate harmful deepfake content depicting minors in a sexualized manner, directly causing emotional, privacy, and legal harms. This satisfies the criteria for an AI Incident, as the AI’s misuse has directly led to significant harm.
Thumbnail Image

5 hommes sont mis en cause pour des photos dénudées de jeunes filles générées par IA

2024-08-06
KultureGeek
Why's our monitor labelling this an incident or hazard?
The event explicitly mentions the use of AI software to generate fake nude photos of minors, which were then disseminated, causing emotional and social harm to the victims. This harm includes violations of privacy and potentially other legal rights. The AI system's use directly led to these harms, fulfilling the criteria for an AI Incident. The event is not merely a potential risk or a complementary update but a realized harm caused by AI-generated content.
Thumbnail Image

Faits divers - Espagne : cinq jeunes mis en cause pour des photos dénudées de jeunes filles générées par IA

2024-08-05
Le Populaire du Centre
Why's our monitor labelling this an incident or hazard?
The article explicitly states that AI software was used to create fake nude images of minors, which were then disseminated, causing significant harm to the victims. This meets the definition of an AI Incident because the AI system's use directly led to violations of rights and harm to individuals. The involvement of AI in generating the images is clear, and the harm is realized, not just potential. Therefore, this event qualifies as an AI Incident.
Thumbnail Image

Ils créent des photos de jeunes filles nues avec l'IA, la police débarque chez eux

2024-08-06
LEBIGDATA.FR
Why's our monitor labelling this an incident or hazard?
The article explicitly states that AI tools were used to create fake nude photos of young girls, which were then shared online, causing serious psychological and social harm. This constitutes a violation of privacy and likely breaches legal protections related to personal rights. The harm is realized and directly linked to the use of AI-generated content. Therefore, this qualifies as an AI Incident due to the direct harm caused by the malicious use of AI systems to produce and distribute non-consensual explicit images.
Thumbnail Image

Ils diffusaient des photos dénudées de mineures générées grâce à l'IA: cinq jeunes hommes mis en cause en Espagne

2024-08-05
RTL Info
Why's our monitor labelling this an incident or hazard?
The article describes an incident where AI-generated nude images of minors were distributed, constituting a direct violation of privacy and potentially child exploitation laws. The AI system's use in creating these deepfakes directly led to harm to individuals (minors) and breaches of legal protections, fitting the definition of an AI Incident. The involvement of AI in generating harmful content and the resulting legal implications confirm this classification.
Thumbnail Image

Ils diffusaient des photos de mineures modifiées en images pornos

2024-08-05
L'essentiel
Why's our monitor labelling this an incident or hazard?
The article explicitly states that AI was used to generate fake pornographic images of minors, which were then disseminated, causing harm to the victims. This constitutes a violation of human rights and significant harm to the individuals involved. The AI system's use is directly linked to the harm, making this an AI Incident under the framework.