OpenAI's Use of Underpaid Kenyan Workers for ChatGPT Data Labeling Causes Harm

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

OpenAI outsourced the labeling of toxic and disturbing content for ChatGPT's training to Kenyan workers earning less than $2 per hour. Exposed to graphic material, these workers suffered psychological harm and poor working conditions, raising concerns about labor exploitation and the human cost of developing AI safety systems.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves the development and use of an AI system (ChatGPT) and its content filtering mechanisms, which rely on human labor for data labeling. The harm described is to the health and well-being of the Kenyan workers who were exposed to traumatic content during this process, constituting injury or harm to a group of people. This harm is indirectly linked to the AI system's development because the AI's training and filtering depend on this labor. Therefore, this qualifies as an AI Incident due to violation of labor rights and harm to health caused indirectly by the AI system's development process.[AI generated]
AI principles
AccountabilityFairnessHuman wellbeingRespect of human rightsSafetyTransparency & explainability

Industries
Real estateReal estate

Affected stakeholders
Workers

Harm types
PsychologicalEconomic/PropertyHuman or fundamental rightsReputational

Severity
AI incident

Business function:
Research and developmentMonitoring and quality control

AI system task:
Interaction support/chatbotsContent generation

In other databases

Articles about this incident or hazard