AI Content Moderation Failures Linked to Molly Russell's Death

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

AI-driven content moderation and recommendation systems on platforms like Instagram failed to block or remove harmful self-harm and suicide-related material, exposing 14-year-old Molly Russell to distressing content. This inadequacy contributed to her death, as confirmed by a coroner, highlighting the risks of ineffective AI in safeguarding vulnerable users.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves social media platforms, which use AI systems for content recommendation and moderation. The coroner's verdict indicates that harmful content was accessible to a child, contributing to her death. This harm is directly linked to the use of AI-driven content algorithms that failed to prevent exposure to self-harm and suicide-related material. Therefore, this constitutes an AI Incident involving harm to a person (a minor) due to the AI system's role in content dissemination and moderation failure.[AI generated]
AI principles
SafetyHuman wellbeingAccountabilityRespect of human rightsRobustness & digital securityTransparency & explainability

Industries
Media, social platforms, and marketing

Affected stakeholders
Children

Harm types
Physical (death)Psychological

Severity
AI incident

Business function:
Monitoring and quality control

AI system task:
Recognition/object detectionOrganisation/recommenders

In other databases

Articles about this incident or hazard

Thumbnail Image

Molly Russell inquest: Family 'numb' about inquest verdict

2022-10-07
Yahoo Sports Canada
Why's our monitor labelling this an incident or hazard?
The event involves social media platforms, which use AI systems for content recommendation and moderation. The coroner's verdict indicates that harmful content was accessible to a child, contributing to her death. This harm is directly linked to the use of AI-driven content algorithms that failed to prevent exposure to self-harm and suicide-related material. Therefore, this constitutes an AI Incident involving harm to a person (a minor) due to the AI system's role in content dissemination and moderation failure.
Thumbnail Image

Molly Russell inquest: Family urges action on harmful content

2022-10-07
Yahoo News
Why's our monitor labelling this an incident or hazard?
The event explicitly involves social media platforms, which use AI systems for content recommendation and moderation. The harmful content that contributed to Molly's death was disseminated through these platforms, indicating the AI systems' role in enabling access to such content. The harm (death by self-harm influenced by harmful online content) has already occurred, making this an AI Incident. The family's call for regulation highlights the failure of current AI-driven content moderation to prevent access to harmful material, directly linking AI system use to harm.
Thumbnail Image

BBC Radio 4 - Best of Today, Molly Russell inquest: Family 'numb' about verdict

2022-10-07
BBC
Why's our monitor labelling this an incident or hazard?
Social media platforms typically use AI systems for content recommendation and moderation. The inquest found that harmful content related to self-harm and suicide was accessible to a child, contributing to her death. This indicates that the AI systems' outputs or failures in content filtering indirectly led to harm to a person, fulfilling the criteria for an AI Incident involving violation of health and safety (harm to a person).
Thumbnail Image

Instagram still hosting self-harm images after Molly Russell inquest verdict

2022-10-08
The Guardian
Why's our monitor labelling this an incident or hazard?
Instagram uses AI-based content moderation and recommendation algorithms to detect and remove harmful content and to suggest posts to users. The article details that despite policies banning self-harm and suicide-glorifying content, such posts remain live, including graphic images and memes that normalize or glamorize self-harm. This failure in AI moderation and recommendation systems has been linked to the death of a young user, indicating direct or indirect harm to health and communities. The AI system's malfunction or inadequacy in enforcing policies and controlling harmful content dissemination constitutes an AI Incident under the OECD framework, as it has directly or indirectly led to harm to persons and communities.
Thumbnail Image

Molly Russell´s father calls for independent regulation of online...

2022-10-07
Daily Mail Online
Why's our monitor labelling this an incident or hazard?
The article centers on the negative effects of online content on a minor and the call for regulatory reform to protect children. While online platforms often use AI systems for content recommendation and moderation, the article does not explicitly mention AI systems or their role in causing harm. The harm described is linked to online content generally, without specifying AI involvement. The main narrative is about advocacy for regulation and safety measures, which constitutes complementary information about societal and governance responses to online harms potentially involving AI but not detailing an AI incident or hazard itself.
Thumbnail Image

How London teen Molly Russell's suicide could spark social media...

2022-10-08
New York Post
Why's our monitor labelling this an incident or hazard?
The article clearly identifies AI systems (social media algorithms) as directly involved in causing harm (the suicide of a teenager) by pushing harmful content. The harm is realized and significant, involving injury to health and loss of life. The event meets the criteria for an AI Incident because the AI system's use directly led to harm to a person. The article also discusses legal and legislative responses, but the primary focus is on the incident itself and its consequences.
Thumbnail Image

Molly Russell's tragic death exposes cash-over-care mindset of...

2022-10-10
New York Post
Why's our monitor labelling this an incident or hazard?
The article explicitly states that social media platforms used AI algorithms to recommend suicidal and self-harming content to Molly Russell, a 14-year-old girl, which the coroner ruled contributed to her suicide. This is a direct link between the AI system's use and harm to a person, meeting the definition of an AI Incident. The harm is realized and severe, involving injury to health and death. The AI system's malfunction or misuse in content recommendation is central to the incident. Therefore, this event qualifies as an AI Incident rather than a hazard or complementary information.
Thumbnail Image

Ian Russell: 'There are questions that will never be answered about Molly's final hours'

2022-10-06
The Telegraph
Why's our monitor labelling this an incident or hazard?
The social media platforms use AI-driven algorithms to recommend content to users. In this case, these algorithms fed Molly increasing amounts of harmful content related to self-harm and suicide, which the coroner concluded contributed to her death. This is a clear example of an AI system's use indirectly leading to harm to a person (harm to health and life). Therefore, this qualifies as an AI Incident. The article also discusses regulatory and governance responses, but the primary focus is on the incident of harm caused by AI-driven content recommendation.
Thumbnail Image

Molly Russell is the tragic tip of a social media iceberg

2022-10-10
The Telegraph
Why's our monitor labelling this an incident or hazard?
The article explicitly references AI systems in the form of social media algorithms that recommended harmful content, which directly contributed to a person's death by suicide. This constitutes harm to health (a) and harm to communities (d). The AI system's use and malfunction (in pushing harmful content) directly led to this harm. Therefore, this event qualifies as an AI Incident under the OECD framework.
Thumbnail Image

Dad's heartbreaking final words to daughter before tragic teen took her own life

2022-10-08
Mirror
Why's our monitor labelling this an incident or hazard?
The event describes a direct harm (the teen's suicide) linked to the use of AI-driven social media content recommendation systems that exposed her to harmful content. The platforms' AI algorithms failed to filter or block dangerous material, which the coroner and NSPCC highlighted. Therefore, the AI system's use indirectly led to a violation of the child's right to protection and harm to her health, fitting the definition of an AI Incident.
Thumbnail Image

Molly Russell: It's OK to ask if your child is feeling suicidal, says father

2022-10-07
The Sunday Times
Why's our monitor labelling this an incident or hazard?
Social media platforms like Instagram and Pinterest use AI systems to recommend and curate content. The coroner's ruling explicitly states that social media contributed to Molly Russell's death by exposing her to harmful content. This is a direct link between AI system use and harm to a person (mental health leading to suicide). Therefore, this event qualifies as an AI Incident due to indirect harm caused by AI-driven content exposure.
Thumbnail Image

Does big tech monetise adolescent pain? | The Week UK

2022-10-07
The Week UK
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI-powered recommendation engines on social media platforms that provided the adolescent with harmful content related to depression, self-harm, and suicide. This AI system's use directly contributed to the harm (death) of the teenager, fulfilling the criteria for an AI Incident. The harm is to the health of a person (a), and the AI system's role is pivotal in delivering and amplifying harmful content. The article also discusses the systemic monetization of such harmful engagement by Big Tech, reinforcing the AI system's involvement in the harm.
Thumbnail Image

Molly Russell's father calls for independent regulation of online platforms

2022-10-07
Jersey Evening Post
Why's our monitor labelling this an incident or hazard?
While the article addresses harm related to online content, it does not explicitly or implicitly involve an AI system causing or potentially causing harm. The harmful content mentioned is related to social media platforms but without specific reference to AI systems such as recommendation algorithms or content moderation AI causing or failing to prevent harm. The article centers on calls for regulation and policy measures, which is a governance response to broader online safety issues. Therefore, this is best classified as Complementary Information, providing context and societal response to online harms potentially involving AI but not describing a direct AI Incident or Hazard.
Thumbnail Image

Molly Russell's father calls for independent regulation of online platforms

2022-10-07
Shropshire Star
Why's our monitor labelling this an incident or hazard?
The article centers on the broader issue of harmful online content and the need for regulation, referencing the Online Safety Bill and calls for ending self-regulation by internet platforms. While social media platforms likely use AI systems for content recommendation and moderation, the article does not specify AI system involvement in Molly Russell's case or any direct AI-caused harm. The focus is on policy and advocacy rather than a concrete AI Incident or Hazard. Therefore, this is best classified as Complementary Information, providing context on governance and societal responses related to AI-enabled platforms but not describing a new AI Incident or Hazard.
Thumbnail Image

When social media contributes to a teen's death | Canberra CityNews

2022-10-07
Canberra CityNews
Why's our monitor labelling this an incident or hazard?
The article explicitly links social media platforms' use of automated content moderation systems—likely AI-based—to the indirect harm of a teenager's death due to exposure to harmful content. The AI systems' malfunction or inadequacy in filtering harmful content contributed indirectly to the harm (death by self-harm influenced by online content). Therefore, this qualifies as an AI Incident because the AI system's use and malfunction have directly or indirectly led to harm to a person. The article also discusses responses and regulatory efforts, but the primary focus is on the harm caused by AI system use in content moderation.
Thumbnail Image

Instagram still hosting self-harm images after Molly Russell inquest verdict - Pehal News

2022-10-09
Pehal News
Why's our monitor labelling this an incident or hazard?
Instagram uses AI systems for content moderation, including detecting and removing harmful posts and managing hashtags. The failure of these AI systems to effectively identify and remove content that promotes or glorifies self-harm and suicide has allowed harmful material to persist on the platform. This has contributed indirectly to harm to individuals' mental health and well-being, as demonstrated by the inquest into Molly Russell's death. The AI system's malfunction or inadequacy in enforcing content policies is a contributing factor to the harm. Hence, this event meets the criteria for an AI Incident, as the AI system's use and malfunction have directly or indirectly led to harm to persons and communities.
Thumbnail Image

Molly Russell's father pays a heart-rending tribute to his daughter

2022-10-07
Daily Mail Online
Why's our monitor labelling this an incident or hazard?
The event involves AI systems in the form of social media algorithms that recommended and amplified harmful content to a vulnerable user, contributing to her depression and suicide. The coroner's verdict acknowledges the culpability of tech companies and the role of these algorithms in causing harm. This fits the definition of an AI Incident because the AI system's use indirectly led to harm to a person (mental health deterioration and death by suicide). The article does not merely discuss potential harm or general AI-related news but documents a specific harm caused by AI system outputs. Therefore, the classification is AI Incident.
Thumbnail Image

Horas de material perturbador: el fallo que culpó a las redes sociales de empujar a una nena a la muerte

2022-10-03
Todo Noticias
Why's our monitor labelling this an incident or hazard?
The article explicitly links the use of Instagram's AI-driven content recommendation system to the mental health deterioration and eventual death of a minor. The AI system's outputs (recommended disturbing content) directly influenced the victim's exposure to harmful material, which the coroner ruled contributed to her death. This meets the definition of an AI Incident because the AI system's use directly led to harm to a person. The event is not merely a potential hazard or complementary information but a documented incident with legal recognition of harm caused by AI system use.
Thumbnail Image

Adolescente de 14 años se quita la vida debido a las redes sociales; se culpa directamente a Meta y Pinterest de su muerte

2022-10-04
EL IMPARCIAL | Noticias de México y el mundo
Why's our monitor labelling this an incident or hazard?
The article explicitly connects the death of the minor to harmful content on social media platforms that use AI systems for content recommendation and moderation. The coroner's ruling directly blames these platforms, indicating the AI systems' outputs were a contributing factor to the suicide. This meets the criteria for an AI Incident as the AI system's use and malfunction have directly led to harm to a person and violation of their rights to safety and mental health. The involvement is not speculative but confirmed by the official investigation and public statements.
Thumbnail Image

¿Cómo las redes sociales contribuyeron en la muerte de una niña de 14 años?

2022-10-05
Ojo
Why's our monitor labelling this an incident or hazard?
The social media platforms use AI-driven algorithms to recommend content based on user interactions. In this case, these algorithms repeatedly suggested depressive and self-harm related content to the adolescent, which negatively affected her mental health and contributed to her death. This constitutes an AI Incident because the AI system's use directly led to harm to a person (mental health deterioration and suicide). The involvement of AI in content recommendation and its causal link to the harm fulfills the criteria for an AI Incident rather than a hazard or complementary information.
Thumbnail Image

Una niña de 14 años se quitó la vida influenciada por el contenido en redes sociales

2022-10-02
Radio Continental
Why's our monitor labelling this an incident or hazard?
The article explicitly states that the social media platforms' algorithms, which are AI systems that curate user content, sent harmful material to Molly Russell, a 14-year-old girl, contributing to her death by suicide. The AI system's use and malfunction (inadequate content filtering and harmful content recommendation) directly led to harm to a person. The involvement of AI in causing this harm is clear and direct, meeting the criteria for an AI Incident rather than a hazard or complementary information.
Thumbnail Image

El suicidio de una adolescente muestra el lado más oscuro de Instagram: un juez culpa a las redes sociales

2022-10-04
es-us.finanzas.yahoo.com
Why's our monitor labelling this an incident or hazard?
Instagram is an AI system that uses algorithms to recommend and display content. The inquest found that the content shown on Instagram, including videos and images related to suicide and self-harm, contributed to the mental health decline and death of the adolescent. This constitutes harm to a person caused indirectly by the AI system's outputs. The event involves the use of the AI system and its outputs leading to real harm, meeting the criteria for an AI Incident. The ruling is a legal recognition of this harm, not merely a potential risk or complementary information.
Thumbnail Image

UK coroner calls for separate social media sites for children and adults

2022-10-14
Financial Times News
Why's our monitor labelling this an incident or hazard?
The event explicitly involves AI systems (social media algorithms) that influenced the content shown to a vulnerable user, contributing indirectly to her death by suicide. This constitutes harm to a person (mental health and death), fulfilling the criteria for an AI Incident. The coroner's report and company responses confirm the AI system's role in the harm. Therefore, this is classified as an AI Incident.
Thumbnail Image

Molly Russell: Coroner issues prevention of future deaths report

2022-10-14
Yahoo News
Why's our monitor labelling this an incident or hazard?
The social media platforms use AI algorithms to recommend and deliver content, including harmful material that negatively affected the deceased. The coroner's report explicitly identifies the role of algorithms in providing content and adverts, which contributed to the harm. The death resulted from exposure to this content, establishing a direct link between AI system use and harm to a person. Hence, this is an AI Incident as the AI system's use indirectly led to injury (death) through harmful content exposure.
Thumbnail Image

Molly Russell: how a teenager's death put social media on trial

2022-10-11
The Guardian
Why's our monitor labelling this an incident or hazard?
The social media platforms' AI-driven content recommendation systems played an indirect role in the harm suffered by Molly Russell by exposing her to harmful content that contributed to her depression and eventual self-harm. This fits the definition of an AI Incident because the AI system's use indirectly led to harm to a person (mental health harm and death).
Thumbnail Image

Molly Russell death: Coroner suggests separate platforms for adults and children

2022-10-14
Shropshire Star
Why's our monitor labelling this an incident or hazard?
The event explicitly involves AI systems in the form of content recommendation algorithms on social media platforms. These algorithms indirectly led to harm by promoting harmful content to a vulnerable child, contributing to her death. The coroner's report and family statements confirm the causal link between the AI-driven content recommendations and the harm. Therefore, this qualifies as an AI Incident due to the realized harm (death) linked to the AI system's outputs. The report also includes recommendations for regulatory and self-regulatory measures, but the primary classification is AI Incident because harm has occurred.
Thumbnail Image

Molly Russell: Coroner's report urges social media changes

2022-10-14
Yahoo Sports Canada
Why's our monitor labelling this an incident or hazard?
The coroner's report explicitly identifies algorithms used by social media platforms as a factor in the exposure of a minor to harmful content that contributed to her suicide. These algorithms are AI systems that recommend content and adverts, influencing what users see. The harm (death of a person due to negative effects of online content) has occurred and is linked indirectly to the AI systems' use. The report calls for regulation and changes to these AI systems to prevent future harm, confirming the AI system's pivotal role in the incident. Hence, this is an AI Incident rather than a hazard or complementary information.
Thumbnail Image

Molly Russell death: Coroner suggests separate platforms for adults and children

2022-10-14
Yahoo Sports Canada
Why's our monitor labelling this an incident or hazard?
The event explicitly mentions algorithms used by social media platforms to provide content and adverts, which are AI systems influencing what users see. The death of Molly Russell was linked to exposure to harmful online content amplified by these algorithms, constituting indirect harm caused by AI system use. The coroner's recommendations aim to mitigate such harms by regulating AI content delivery. Hence, this qualifies as an AI Incident due to the realized harm linked to AI system use.
Thumbnail Image

Molly Russell's case confirms the adverse effects of social media on the young

2022-10-13
The Indian Express
Why's our monitor labelling this an incident or hazard?
The article explicitly references algorithms used by social media platforms that influence user experience and mental health outcomes. These algorithms qualify as AI systems because they infer from user data to generate content recommendations. The harm described is the mental health deterioration and eventual death of a young person, which falls under injury or harm to health. The AI system's use indirectly led to this harm by promoting harmful content. Therefore, this event meets the criteria for an AI Incident due to the direct link between AI-driven content curation and realized harm to a person.
Thumbnail Image

My daughter, 14, killed herself after seeing suicide posts - we need action

2022-10-14
The Sun
Why's our monitor labelling this an incident or hazard?
The event involves AI systems in the form of social media content recommendation algorithms that directly contributed to the harm (a minor's suicide) by amplifying harmful content. The coroner's report and family statements confirm the causal link between the AI-driven algorithms and the harm. This constitutes an AI Incident because the AI system's use has directly led to injury or harm to a person, fulfilling the definition of an AI Incident under the framework.
Thumbnail Image

Molly Russell coroner calls for separate social media platforms for adults and children

2022-10-14
The Telegraph
Why's our monitor labelling this an incident or hazard?
The coroner explicitly identifies the role of social media algorithms in contributing to the death of Molly Russell by feeding her harmful content, which is a direct or indirect harm to health and well-being caused by AI system use. The event involves the use of AI systems (recommendation algorithms) that led to harm (a suicide linked to exposure to harmful content). Therefore, this qualifies as an AI Incident. The article also discusses regulatory responses and calls for legislation, but the primary focus is on the harm caused by AI systems in social media platforms.
Thumbnail Image

Coroner at Molly Russell's inquest urges social media changes

2022-10-14
EXPRESS
Why's our monitor labelling this an incident or hazard?
The article describes how AI-powered algorithms on social media platforms recommended harmful content related to suicide and self-harm to a 14-year-old girl, which was a contributing factor in her death. The AI system's use in content recommendation and age verification failures directly or indirectly led to harm to a person, fulfilling the criteria for an AI Incident. The harm is realized, not just potential, and the AI system's role is pivotal in the chain of events leading to the harm.
Thumbnail Image

Molly Russell coroner urges social media firms and government to take action following teen's death

2022-10-14
Sky News
Why's our monitor labelling this an incident or hazard?
The social media platforms use AI-driven recommendation algorithms that influence the content users see. The coroner's report explicitly links these algorithms to the amplification of harmful content that contributed to the death of a minor. This is a clear case where the AI system's use indirectly led to harm (mental health deterioration and death), fulfilling the criteria for an AI Incident. The event is not merely a warning or potential risk but follows a realized harm, and the coroner's report is a response to that harm, emphasizing the need for changes in AI system design and regulation.
Thumbnail Image

Lawyer of the week: Oliver Sanders KC, who acted for the family of Molly Russell, 14, who took her own life after viewing social media content

2022-10-12
The Sunday Times
Why's our monitor labelling this an incident or hazard?
The social media platforms use AI systems to recommend and curate content, including potentially harmful material related to suicide and self-harm. The AI system's role in exposing the teenager to extensive harmful content that contributed to her death constitutes indirect harm to health. Therefore, this qualifies as an AI Incident due to the AI system's indirect contribution to injury or harm to a person.
Thumbnail Image

Molly Russell death: Coroner suggests separate platforms for adults and children

2022-10-14
Evening Standard
Why's our monitor labelling this an incident or hazard?
The event explicitly discusses the use of algorithms by social media platforms to provide content, which is a form of AI system involvement. The death of Molly Russell is linked indirectly to the AI-driven recommendation of harmful content, constituting harm to a person (a). The coroner's report and family statements confirm that the AI systems' outputs contributed to the harm. Therefore, this qualifies as an AI Incident due to the realized harm caused by the AI systems' use and malfunction in content recommendation.
Thumbnail Image

Molly Russell death: Coroner suggests separate platforms for adults and children

2022-10-14
Evening Standard
Why's our monitor labelling this an incident or hazard?
The coroner's report explicitly calls for a review of algorithms used by major social media platforms, which are AI systems that influence content exposure. The death of Molly Russell after viewing harmful content online demonstrates harm to a person linked to these AI systems' outputs. The event describes realized harm (a fatality) connected to the use of AI systems (content recommendation algorithms), meeting the criteria for an AI Incident. The focus is on the harm caused and the AI systems' role, not just potential future harm or general commentary, so it is not a hazard or complementary information.
Thumbnail Image

Molly Russell: Coroner Says Social Media Platforms for Adults and Children Should Be Separated

2022-10-14
Tech Times
Why's our monitor labelling this an incident or hazard?
Social media platforms use AI algorithms to recommend and curate content, which in this case led to the exposure of harmful content to a minor, contributing to her suicide. The coroner's report and recommendations highlight the role of these platforms and their AI systems in the harm. Since the harm (death) has occurred and the AI system's use indirectly led to it, this is an AI Incident. The article does not merely discuss potential future harm or general AI governance but reports on a specific harm linked to AI system use.
Thumbnail Image

Molly Russell death: Coroner suggests separate platforms for adults and children

2022-10-14
Belfast Telegraph
Why's our monitor labelling this an incident or hazard?
The online content viewed by the teenager can be reasonably inferred to be curated or recommended by AI systems (e.g., algorithms on social media platforms) that influence what content users see. The harmful content's availability and exposure to a child led indirectly to harm (death) through self-harm and depression. This fits the definition of an AI Incident because the AI system's use (content recommendation algorithms) indirectly led to harm to a person. The coroner's suggestion for separate platforms for adults and children further supports the role of AI-driven content delivery in the harm.
Thumbnail Image

Molly Russell death: Coroner suggests separate platforms for adults and children

2022-10-14
Jersey Evening Post
Why's our monitor labelling this an incident or hazard?
The event explicitly discusses the role of algorithms used by social media platforms to provide content, which are AI systems as they infer from user data to recommend content. The coroner's findings link these algorithms to the negative effects of online content that contributed to the death of a child, constituting harm to a person. The recommendations focus on regulating these AI systems to prevent similar incidents, confirming the AI system's involvement in causing harm. Therefore, this qualifies as an AI Incident due to the indirect harm caused by AI-driven content recommendation algorithms.
Thumbnail Image

'Don't drag your feet on change' Molly Russell's dad tells social media firms

2022-10-14
Hull Daily Mail
Why's our monitor labelling this an incident or hazard?
The event involves AI systems in the form of social media platform algorithms that amplify harmful content, which contributed indirectly to the death of a child. The harm (death by self-harm influenced by harmful online content) has already occurred, and the AI system's role is pivotal in the amplification and exposure to such content. Therefore, this qualifies as an AI Incident due to indirect harm to a person caused by the use of AI systems (algorithms) in social media platforms.
Thumbnail Image

Molly Russell death: Coroner suggests separate platforms for adults and children

2022-10-14
The Northern Echo
Why's our monitor labelling this an incident or hazard?
Social media platforms use AI systems (algorithms) to curate and recommend content. The coroner's report suggests these algorithms may have played a role in harm to a user (Molly Russell), indicating indirect harm caused by AI system use. The recommendations aim to prevent future harm by changing AI system design and deployment. Therefore, this event concerns harm that has occurred linked to AI system use and recommendations to prevent recurrence, fitting the definition of an AI Incident.
Thumbnail Image

Molly Russell death: Coroner suggests separate platforms for adults and children

2022-10-14
Wandsworth Times
Why's our monitor labelling this an incident or hazard?
The event explicitly involves AI systems in the form of algorithms used by social media platforms to recommend content. These algorithms indirectly led to harm by exposing a child to harmful suicide and self-harm content, contributing to her death. The coroner's report and family statements confirm the causal link between the AI-driven content delivery and the harm. Therefore, this qualifies as an AI Incident due to the realized harm caused by the AI system's use.
Thumbnail Image

Molly Russell coroner calls for review of children's social media access

2022-10-14
The Guardian
Why's our monitor labelling this an incident or hazard?
The event describes a death caused by exposure to harmful online content delivered via social media platforms that use AI algorithms to recommend content. The coroner's report explicitly links social media's algorithmic content delivery to the harm suffered by Molly Russell, fulfilling the criteria for an AI Incident. The AI system's use (content recommendation algorithms) indirectly led to harm (death by self-harm influenced by harmful content). The report also discusses regulatory and self-regulatory responses, but the primary event is the harm caused by AI-driven content delivery, not just the response, so it is not Complementary Information. Hence, the classification is AI Incident.
Thumbnail Image

Cyber safety unit pulls social media ads due to concerns

2022-10-11
Devon Live
Why's our monitor labelling this an incident or hazard?
The social media platforms use AI systems (algorithms) to recommend content, which directly influenced the exposure of harmful material to a vulnerable user, leading to serious mental health harm and death. This fits the definition of an AI Incident because the AI system's use has directly led to harm to a person. The event is not merely a potential hazard or complementary information; it reports on a realized harm linked to AI system operation. Therefore, the classification is AI Incident.
Thumbnail Image

Molly Russell coroner calls for separate social media platforms for adults and children

2022-10-15
Yahoo News UK
Why's our monitor labelling this an incident or hazard?
The event explicitly links the use of AI algorithms on social media platforms to the death of a child by promoting harmful content. The coroner's findings and recommendations focus on the AI systems' role in feeding children dangerous material, which directly caused harm (a suicide). This fits the definition of an AI Incident as the AI system's use directly led to injury or harm to a person. The event is not merely a potential hazard or complementary information but a documented incident with real harm caused by AI system use.
Thumbnail Image

Will the death of a British teenager hold social media accountable?

2022-10-18
Euronews English
Why's our monitor labelling this an incident or hazard?
The social media platforms use AI systems to recommend content based on user engagement and behavior. In this case, these AI systems recommended suicide and self-harm related content to a vulnerable teenager, which was a contributing factor to her suicide. The coroner's ruling explicitly attributes the death to the negative effects of online content recommended by these AI systems. This constitutes an AI Incident because the AI system's use directly led to harm to a person (the teenager's death). The article also discusses ongoing legal and policy responses, but the primary event is the realized harm caused by AI-driven content recommendations.
Thumbnail Image

The 'Views' That Kill

2022-10-16
Deccan Chronicle
Why's our monitor labelling this an incident or hazard?
The event explicitly involves AI systems in the form of recommender algorithms that optimize content delivery based on user interactions. These AI systems indirectly led to harm (suicide) by promoting self-harm content to vulnerable teenagers. The harm is a violation of health and well-being (a), and the AI's role is pivotal in causing this harm. Therefore, this qualifies as an AI Incident.
Thumbnail Image

Perspective: Social media's 'Big Tobacco' moment

2022-10-19
Deseret News
Why's our monitor labelling this an incident or hazard?
The event involves AI systems explicitly described as machine-learning algorithms used by social media platforms to recommend content. These algorithms' use directly led to harm (a suicide) by promoting harmful content to a vulnerable user, fulfilling the criteria for an AI Incident. The article details the causal link between the AI system's use and the harm, as well as the societal and legal responses, but the primary event is the harm caused by the AI system's use. Therefore, this is classified as an AI Incident.
Thumbnail Image

Children should have separate sections in social media sites

2022-10-18
TheRegister.com
Why's our monitor labelling this an incident or hazard?
The article primarily focuses on recommendations, legislative proposals, and societal/governance responses to the risks posed by AI-driven social media algorithms and content to children. It does not report a specific AI Incident (harm realized) or an AI Hazard (plausible future harm from a particular event). Instead, it provides complementary information about ongoing efforts to mitigate AI-related harms in social media, including parental controls, age verification, and regulatory challenges. Therefore, the event is best classified as Complementary Information, as it enhances understanding of AI's societal impacts and governance without describing a new incident or hazard.
Thumbnail Image

Molly Russell coroner calls for separate social media platforms for children and adults

2022-10-17
Computing
Why's our monitor labelling this an incident or hazard?
The event involves AI systems explicitly through the mention of algorithms recommending harmful content to a minor, which indirectly led to harm (the teenager's suicide). The coroner's report and recommendations address the use and impact of AI systems in social media content curation and their role in causing harm. Therefore, this qualifies as an AI Incident because the AI system's use directly contributed to harm to a person.
Thumbnail Image

The Molly Russell inquest: it's time to shift the narrative

2022-10-18
Palatinate
Why's our monitor labelling this an incident or hazard?
Social media platforms employ AI systems for content recommendation and moderation. In this case, the AI systems indirectly contributed to harm by allowing distressing content to be accessible and recommended to a vulnerable minor, which was a factor in her suicide. This constitutes an AI Incident because the AI system's use and malfunction (ineffective content filtering) directly or indirectly led to harm to a person (a child). The article focuses on the harm caused and the need for regulatory and technological improvements, fitting the definition of an AI Incident rather than a hazard or complementary information.