Experts Warn of Risks from AI-Powered Toys for Children

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Researchers and experts are raising concerns about AI-powered toys, such as chatbot teddy bears using generative AI like ChatGPT, which are marketed to young children. Potential risks include threats to children's privacy, neurodevelopment, and emotional wellbeing, as well as exposure to inappropriate content. No actual harm has been reported yet.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly involves AI systems embedded in toys (generative AI engines like ChatGPT) used by children. It does not report a realized harm incident but focuses on the potential risks and harms that could plausibly arise from these AI toys' use, such as emotional manipulation, privacy breaches, and developmental harm. This fits the definition of an AI Hazard, as the development and use of these AI systems in toys could plausibly lead to AI Incidents involving harm to children's health, rights, and wellbeing. The article also discusses the need for safety-by-design and supervision, reinforcing the potential for future harm rather than describing an actual incident or complementary information about responses or governance.[AI generated]
AI principles
Privacy & data governanceSafety

Industries
Consumer products

Affected stakeholders
Children

Harm types
Human or fundamental rightsPsychological

Severity
AI hazard

AI system task:
Interaction support/chatbotsContent generation


Articles about this incident or hazard

Thumbnail Image

Chatbot teddies for three-year-olds? Why AI toys are risky for kids

2026-06-03
The Conversation
Why's our monitor labelling this an incident or hazard?
The article explicitly involves AI systems embedded in toys (generative AI engines like ChatGPT) used by children. It does not report a realized harm incident but focuses on the potential risks and harms that could plausibly arise from these AI toys' use, such as emotional manipulation, privacy breaches, and developmental harm. This fits the definition of an AI Hazard, as the development and use of these AI systems in toys could plausibly lead to AI Incidents involving harm to children's health, rights, and wellbeing. The article also discusses the need for safety-by-design and supervision, reinforcing the potential for future harm rather than describing an actual incident or complementary information about responses or governance.
Thumbnail Image

AI Teddy Bears Told Kids About Sex and Weapons - Experts Demand Holiday Shopping Ban

2026-06-03
Gadget Review
Why's our monitor labelling this an incident or hazard?
The event involves an AI system (the Kumma teddy bear powered by GPT-4o) whose use directly caused harm to children by generating inappropriate and dangerous content. This meets the definition of an AI Incident because the AI system's outputs have directly led to harm to a vulnerable group (children), including potential developmental damage and safety risks. The regulatory and expert warnings further confirm the seriousness of the harm. Therefore, this is classified as an AI Incident.
Thumbnail Image

Chatbot teddies for three-year-olds? Why AI toys are risky for kids

2026-06-03
Yahoo!7 News
Why's our monitor labelling this an incident or hazard?
The article clearly involves AI systems (AI-powered conversational toys using generative AI like ChatGPT). It discusses the use of these AI systems and the plausible risks they pose to children's wellbeing, privacy, and social development. No direct or indirect harm has been reported as having occurred yet, but the risks are credible and plausible. Hence, this fits the definition of an AI Hazard, as the development and use of AI toys could plausibly lead to harms such as emotional harm, privacy violations, or developmental issues in children. It is not an AI Incident because no actual harm has been documented. It is not Complementary Information because it does not provide updates or responses to a known incident or hazard. It is not Unrelated because it clearly concerns AI systems and their potential impacts.
Thumbnail Image

Experts Sound Alarm On Kids' AI Toys Designed To 'Sound Human'

2026-06-03
End Time Headlines
Why's our monitor labelling this an incident or hazard?
The toys are AI systems using generative AI to interact with children, creating artificial trust and encouraging prolonged engagement. The researchers highlight risks to children's social and emotional growth, including potential displacement of human interactions and increased loneliness. Since no actual harm is reported but credible concerns about future harm exist, this fits the definition of an AI Hazard rather than an AI Incident. The event is not merely general AI news or a response update, so it is not Complementary Information, nor is it unrelated.
Thumbnail Image

Rise in AI toys raises concerns over children's safety and privacy

2026-06-04
Australian Broadcasting Corporation
Why's our monitor labelling this an incident or hazard?
The article mentions AI systems embedded in toys and highlights concerns about privacy and information risks, which could plausibly lead to harm to children or their communities. However, there is no indication that any harm has occurred or that an incident has taken place. Therefore, this qualifies as an AI Hazard, reflecting credible potential risks from the development and use of AI toys, but not an AI Incident or Complementary Information.
Thumbnail Image

Chatbot teddies for three-year-olds? Why AI toys are risky for kids

2026-06-03
NZCity
Why's our monitor labelling this an incident or hazard?
The article does not describe a realized harm or incident caused by AI toys but rather warns about the plausible risks and potential harms these AI systems could cause to children's wellbeing, privacy, and development. It emphasizes the need for further research and safety-by-design approaches to mitigate these risks. Therefore, the event fits the definition of an AI Hazard, as it plausibly could lead to harms such as emotional harm, privacy violations, and developmental issues in children due to the use of AI systems in toys.
Thumbnail Image

Exploring Neurodevelopmental Risks and Privacy Concerns of AI-Powered Toys

2026-06-02
Scienmag: Latest Science and Health News
Why's our monitor labelling this an incident or hazard?
The article does not describe a realized harm or incident caused by AI toys but rather outlines credible and significant risks that could plausibly lead to harm in children's neurodevelopment, privacy, and safety. The involvement of AI systems is explicit, and the concerns raised about developmental impact, data security vulnerabilities, and exposure to harmful content constitute potential harms. Therefore, the event fits the definition of an AI Hazard, as it plausibly could lead to AI Incidents if these risks materialize. It is not Complementary Information because it does not report on responses or updates to past incidents, nor is it Unrelated since it directly concerns AI systems and their potential impacts.
Thumbnail Image

Chatbot Teddy Bears Are Here: Experts Sound Alarm On Kids' AI Toys Designed To 'Sound Human'

2026-06-03
StudyFinds
Why's our monitor labelling this an incident or hazard?
The event involves AI systems (generative AI chatbots in toys) whose use could plausibly lead to harms including emotional and social development issues, privacy violations, and exposure to harmful content. These risks are directly linked to the AI system's use and design, such as the AI's human-like conversational style and infinite chat capabilities. Since the article does not report actual realized harm but warns of credible potential harms, this fits the definition of an AI Hazard rather than an AI Incident. The article also discusses the broader ecosystem and calls for safety-by-design and supervision, but the primary focus is on the plausible future harms posed by these AI toys.