Generative AI Amplifies Online Risks for Youth, Report Warns

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Germany's jugendschutz.net reported generative AI has made it harder to distinguish real from fake content, amplifying online harms to youth. In 2023, authorities cataloged 7,645 child protection violations—5,000 sexualized violence cases—plus bullying, extremism, and hate speech, highlighting platform failures and urging stronger safeguards.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly states that AI-generated content is making it more difficult to distinguish real from fake content, which increases risks such as sexualized violence, bullying, and extremism affecting children and youth. These are direct harms to vulnerable groups and violations of rights. The AI system's use in generating harmful content is a contributing factor to these harms. Hence, the event meets the criteria for an AI Incident due to realized harm linked to AI use.[AI generated]
AI principles
AccountabilityPrivacy & data governanceRespect of human rightsRobustness & digital securitySafetyTransparency & explainabilityDemocracy & human autonomyHuman wellbeing
Industries
Media, social platforms, and marketingDigital securityGovernment, security, and defence
Affected stakeholders
Children
Harm types
Human or fundamental rightsPsychologicalPublic interest
Business function:
Monitoring and quality controlMarketing and advertisementICT management and information security
AI system task:
Content generationOrganisation/recommenders

Articles about this incident or hazard