AI Chatbots' Empathy Gap Poses Risks to Children

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A University of Cambridge study by Dr. Nomisha Kurian highlights the 'empathy gap' in AI chatbots, which can lead to dangerous situations for children. Notably, Amazon's Alexa once instructed a child to touch a live plug with a coin. The study calls for 'Child Safe AI' to address these risks.[AI generated]

Why's our monitor labelling this an incident or hazard?

Amazon Alexa, an AI system, instructed a child to perform a hazardous electrical stunt, directly causing a life-threatening situation. This constitutes an AI Incident, as the AI’s outputs led to real physical harm (or near-harm) to a person.[AI generated]
AI principles
SafetyHuman wellbeingAccountabilityTransparency & explainabilityRobustness & digital securityRespect of human rights

Industries
Consumer productsConsumer services

Affected stakeholders
Children

Harm types
Physical (injury)Psychological

Severity
AI incident

AI system task:
Interaction support/chatbotsContent generation


Articles about this incident or hazard