La Guardia Civil investiga a tres menores por montajes porno de compañeras a través de IA
2024-04-10
LaVanguardia
The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
Three minors in Mallorca are under investigation for using AI tools to create and share manipulated pornographic images of their classmates, aged 14, by extracting photos from social media. The incident highlights the misuse of AI for generating explicit fake content, causing harm to minors and raising legal and privacy concerns.[AI generated]
Why's our monitor labelling this an incident or hazard?
The article explicitly states that AI was used to generate realistic fake sexual images of minors, which were then spread massively, causing harm to the victims. This constitutes a violation of rights (including privacy and protection of minors) and harm to communities. The involvement of AI in creating these images and the resulting harm meets the criteria for an AI Incident, as the AI system's use directly led to significant harm.[AI generated]