The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
Three male minors in Molina de Segura, Murcia, were investigated by the National Police for using AI applications to manipulate and distribute sexualized images of female classmates without consent. The incident led to charges of child pornography and violations of privacy and moral integrity.[AI generated]
Why's our monitor labelling this an incident or hazard?
The event explicitly mentions the use of AI applications to manipulate images, which qualifies as an AI system involvement. The harm caused includes violations of privacy, moral integrity, and the creation and distribution of child pornography, which are serious legal and human rights violations. The AI system's use directly led to these harms, fulfilling the criteria for an AI Incident. The event is not merely a potential risk or a societal response but a realized harm caused by AI-enabled manipulation and dissemination of images.[AI generated]