AI Monitoring System Causes Psychological Harm to Teachers at UK Tech Firm

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Multiverse, a UK tech training company, deployed an AI system to monitor and rate teachers' performance by analyzing online lesson transcripts. Staff report severe stress, anxiety, insomnia, and a need for therapy due to constant AI-driven surveillance and scoring, highlighting direct psychological harm caused by the system's use.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly states that the AI system is used to monitor and rate teachers, leading to 'horrendous stress,' sleep loss, and therapy seeking among staff. The AI's role is pivotal in causing this psychological harm through its surveillance and performance scoring. The harm is direct and materialized, fulfilling the criteria for an AI Incident under harm to health. The AI system is clearly involved in the use phase, and the harm is ongoing and significant. Hence, the event is classified as an AI Incident.[AI generated]
AI principles
Human wellbeingRespect of human rights

Industries
Education and training

Affected stakeholders
Workers

Harm types
Psychological

Business function:
Human resource management

AI system task:
Forecasting/prediction


Articles about this incident or hazard