Spanish Ombudsman Investigates Harmful AI-Driven Social Media Content Affecting Minors

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

The Spanish Ombudsman launched an investigation after a minor suffered self-harm and suicidal tendencies due to harmful content recommended by social media algorithms (AI systems) on X. Authorities are assessing measures to protect minors, following complaints about the platform's failure to remove dangerous content.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly mentions that social media algorithms detect user behavior and automatically provide harmful content, which is a clear involvement of AI systems. The harm is realized, as a minor with a history of self-harm and suicide attempt was exposed to harmful content via these algorithms. The investigation and regulatory debate further confirm the seriousness of the harm caused. Hence, this is an AI Incident due to the AI system's role in causing harm to a vulnerable individual.[AI generated]
AI principles
SafetyHuman wellbeing

Industries
Media, social platforms, and marketing

Affected stakeholders
Children

Harm types
Psychological

Severity
AI incident

Business function:
Marketing and advertisement

AI system task:
Organisation/recommenders


Articles about this incident or hazard

Thumbnail Image

El Defensor del Pueblo reclama a las administraciones que expliquen cómo protegen a los menores ante el "peligro extremo" de las redes sociales

2026-05-21
EL PAÍS
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions algorithms on social media platforms that automatically provide harmful content to minors, which is an AI system influencing user experience. Although harm to a specific minor has occurred, the article focuses on the institutional response and preventive measures rather than detailing a direct causal AI incident. The Defensor del Pueblo's inquiry into protections and protocols indicates concern about plausible future harms from AI-driven content recommendation systems. Hence, this event fits the definition of an AI Hazard rather than an AI Incident or Complementary Information.
Thumbnail Image

El Defensor del Pueblo abre investigación sobre las redes sociales tras el intento de suicidio de una menor

2026-05-21
eldiario.es
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions that social media algorithms detect user behavior and automatically provide harmful content, which is a clear involvement of AI systems. The harm is realized, as a minor with a history of self-harm and suicide attempt was exposed to harmful content via these algorithms. The investigation and regulatory debate further confirm the seriousness of the harm caused. Hence, this is an AI Incident due to the AI system's role in causing harm to a vulnerable individual.
Thumbnail Image

El Defensor del Pueblo abre una investigación sobre las redes sociales tras el intento de suicidio de una menor

2026-05-21
La Voz de Galicia
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions that social media algorithms automatically provide harmful content to vulnerable minors, which has led to real harm (an attempted suicide). The AI system's use is directly linked to harm to health and physical integrity, fulfilling the criteria for an AI Incident. The investigation and inquiries by public bodies are responses to this incident, but the primary event is the harm caused by the AI system's content recommendations.
Thumbnail Image

Una niña española entraba en X y se autolesionaba, pero la red social no hizo nada: el Defensor del Pueblo pide explicaciones al Gobierno

2026-05-21
El HuffPost
Why's our monitor labelling this an incident or hazard?
The article explicitly describes an AI system (social media algorithms) that automatically provides harmful content to a vulnerable minor, leading to self-harm and suicidal behavior, which is a direct injury to health. The platform's refusal to remove such content despite legal obligations further implicates the AI system's role in causing harm. The involvement of government authorities and legal frameworks confirms the seriousness and realization of harm. Hence, this is an AI Incident as the AI system's use has directly led to harm to a person.
Thumbnail Image

El Defensor del Pueblo abre una investigación tras la denuncia del padre de una menor expuesta a contenidos sobre suicidio y autolesiones en X

2026-05-21
Cadena SER
Why's our monitor labelling this an incident or hazard?
The social media platform's recommendation algorithms, which are AI systems, have indirectly led to harm by reinforcing exposure to harmful content about suicide and self-harm to a minor. The harm involves risk to the minor's physical and mental health, fitting the definition of injury or harm to a person. The investigation and complaints indicate that the AI system's outputs (content recommendations) have contributed to this harm. Hence, this is an AI Incident rather than a hazard or complementary information, as harm has already occurred or is ongoing due to AI system use.
Thumbnail Image

El Defensor del Pueblo investiga cómo las administraciones abordan las consecuencias nocivas de las redes sociales en menores

2026-05-21
Público.es
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions algorithms of social media platforms that automatically recommend harmful content to vulnerable minors, which involves AI systems. The harm (exposure to dangerous content leading to self-harm and suicide risk) is real and has occurred, but the article focuses on the investigation and administrative responses rather than describing a new AI Incident itself. It does not report a new direct or indirect AI Incident but rather complements understanding of ongoing societal and governance responses to AI-related harms in social media. Hence, it fits the definition of Complementary Information.
Thumbnail Image

El Defensor investiga cómo protege la administración a los menores 'dañados' por las redes sociales | Canarias7

2026-05-21
Canarias7
Why's our monitor labelling this an incident or hazard?
The event involves AI systems in the form of social media algorithms that automatically and continuously provide harmful content to vulnerable minors, which has directly led to harm (self-harm and suicidal tendencies). The AI system's role in promoting harmful content is central to the incident. Therefore, this qualifies as an AI Incident due to the direct harm to a person caused by the AI system's outputs and the ongoing investigation into protective measures and legal implications.
Thumbnail Image

El Defensor pide información a Gobierno y Fiscalía sobre medidas para proteger a menores ante efectos "nocivos" de RRSS

2026-05-21
Teleprensa
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the role of social media algorithms (AI systems) in automatically providing harmful content to minors, which has led to real harm (self-harm and suicidal tendencies). However, the article does not report a new AI Incident per se but rather the Defensor del Pueblo's action to gather information and assess measures to address these harms. This fits the definition of Complementary Information because it details governance and societal responses to an existing AI-related harm context, rather than describing a new AI Incident or AI Hazard. The AI system's involvement is clear, and harm is recognized, but the focus is on the institutional response and information gathering, not on a specific incident or hazard event.