
The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
A man in Cáceres, Spain, is under investigation for creating and distributing sexualized deepfake images of minors using AI applications. The images, generated from photos taken from social media, resulted in multiple complaints and legal action due to violations of minors' rights and psychological harm.[AI generated]
Why's our monitor labelling this an incident or hazard?
The article explicitly states that an AI application was used to generate manipulated sexualized images of minors, which is a direct use of AI leading to harm. The harms include violations of rights (sexual freedom and indemnity), psychological and emotional harm to the victims, and legal consequences. This fits the definition of an AI Incident because the AI system's use directly led to significant harm and legal violations. The event is not merely a potential risk or a complementary update but a concrete incident involving AI misuse causing harm.[AI generated]