New York School Halts AI Humanoid Robot Deployment Amid Privacy and Ethics Concerns

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A New York high school's plan to introduce the AI humanoid robot 'Sally' as an educational assistant was suspended after strong opposition from parents and teachers. Concerns included potential disruption of student-teacher relationships, privacy risks, and controversy over the manufacturer's links to adult AI robots.[AI generated]

Why's our monitor labelling this an incident or hazard?

An AI humanoid robot was deployed in a school setting to assist education, involving an AI system interacting with students. The controversy and suspension stem from concerns about potential harms: weakening human relationships (harm to communities), privacy and data protection issues (potential violation of rights), and the problematic association with adult robot manufacturers raising ethical concerns. No actual harm has been reported yet, but the plausible risks and the suspension pending further review indicate a credible potential for harm. Hence, this is best classified as an AI Hazard rather than an AI Incident or Complementary Information. It is not Beneficial Use because the AI system itself is the source of potential harm, not solely a countermeasure to external harm. It is not Unrelated because the AI system is central to the event.[AI generated]
AI principles
Privacy & data governance

Industries
Education and training

Affected stakeholders
ChildrenWorkers

Harm types
Human or fundamental rightsPsychological

AI system task:
Interaction support/chatbots


Articles about this incident or hazard