The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
A European Commission report highlights serious risks to children's physical and mental health from widespread use of AI tools online, including the creation of synthetic child sexual abuse material. The report, presented by Ursula von der Leyen, underscores the vulnerability of minors to AI-enabled harms on digital platforms across the EU.[AI generated]
Why's our monitor labelling this an incident or hazard?
The report explicitly identifies AI tools as a source of serious threats to children online, particularly through the production of synthetic child sexual abuse material, which is a direct harm to children's mental and physical health and a violation of their rights. The involvement of AI in generating such harmful content is clear and the harm is realized, not hypothetical. Hence, this meets the criteria for an AI Incident, as the AI system's use has directly led to significant harm to vulnerable groups (children and adolescents).[AI generated]