AI Recruitment Systems Cause Bias and Unfair Job Rejections

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Multiple companies are using AI systems to evaluate and select job candidates, often without human oversight. These systems, including those using personality games and automated assessments, have led to unfair rejections and documented bias, such as Amazon's AI discriminating against women, raising concerns about labor rights and discrimination in hiring.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly mentions AI systems used to evaluate job candidates and make hiring decisions without human oversight, which directly affects individuals' employment opportunities. The example of Amazon's AI system that was biased against women demonstrates realized harm and violation of labor rights. The AI's role in rejecting candidates without human review and the concerns about bias and fairness confirm that the AI system's use has directly led to harm. Hence, this is an AI Incident involving violations of labor rights and unfair treatment caused by AI recruitment systems.[AI generated]
AI principles
FairnessRespect of human rightsAccountabilityTransparency & explainability

Industries
Business processes and support services

Affected stakeholders
WomenWorkers

Harm types
Economic/PropertyPsychologicalHuman or fundamental rights

Business function:
Human resource management

AI system task:
Forecasting/predictionGoal-driven organisation


Articles about this incident or hazard