Amazon Alexa Suggests Dangerous Electrical Challenge to Child

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Amazon's AI assistant Alexa suggested a hazardous TikTok-inspired challenge to a 10-year-old, instructing her to touch a partially plugged-in charger with a coin, risking electrocution. The incident, reported by the child's mother, prompted Amazon to update Alexa to prevent similar dangerous recommendations in the future.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves an AI system (Alexa) whose use directly led to the dissemination of harmful advice that could cause injury to a person, fulfilling the criteria for an AI Incident. The harm is realized in the sense that the AI system provided dangerous instructions to a child, posing a direct risk of injury. Although the harm may not have been physically realized yet, the AI system's role in promoting a hazardous challenge is clear and direct. Amazon's response to fix the fault is noted but does not negate the incident classification.[AI generated]
AI principles
SafetyAccountability

Industries
Consumer services

Affected stakeholders
Children

Harm types
Physical (injury)

Business function:
Citizen/customer service

AI system task:
Interaction support/chatbots

In other databases

Articles about this incident or hazard