AI Hiring Algorithms Amplify Gender Bias Against Women

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Multiple studies reveal that AI hiring algorithms, trained on biased human recruiter data, consistently disadvantage women by replicating and amplifying gender biases in candidate ranking. This leads to discriminatory hiring outcomes, violating labor rights and reducing employment opportunities for women, even when qualifications are equal.[AI generated]

Why's our monitor labelling this an incident or hazard?

The study explicitly involves an AI system (a hiring algorithm) that was developed and used to rank candidates. The AI system's outputs directly reflect and amplify human gender biases, leading to discriminatory outcomes against women. This constitutes a violation of labor rights and gender discrimination, which falls under harm category (c) - violations of human rights or breach of labor rights. Since the AI system's use has directly led to discriminatory bias in hiring recommendations, this qualifies as an AI Incident.[AI generated]
AI principles
FairnessRespect of human rightsTransparency & explainabilityAccountability

Industries
Business processes and support services

Affected stakeholders
WomenWorkers

Harm types
Economic/PropertyHuman or fundamental rights

Severity
AI incident

Business function:
Human resource management

AI system task:
Organisation/recommenders


Articles about this incident or hazard

Thumbnail Image

Study shows how AI exacerbates recruitment bias against women

2020-12-02
The Next Web
Why's our monitor labelling this an incident or hazard?
The study explicitly involves an AI system (a hiring algorithm) that was developed and used to rank candidates. The AI system's outputs directly reflect and amplify human gender biases, leading to discriminatory outcomes against women. This constitutes a violation of labor rights and gender discrimination, which falls under harm category (c) - violations of human rights or breach of labor rights. Since the AI system's use has directly led to discriminatory bias in hiring recommendations, this qualifies as an AI Incident.
Thumbnail Image

AI mimics recruiter gender bias against women, study warns

2020-12-04
Hospital Review
Why's our monitor labelling this an incident or hazard?
The study explicitly involves an AI system (a hiring algorithm) that was developed based on biased human recruiter data and produces biased outputs favoring men over women despite equal qualifications. This bias in the AI's use directly leads to violations of labor rights and discrimination, which constitute harm under the framework. Therefore, this qualifies as an AI Incident because the AI system's use has directly led to harm in the form of gender bias in hiring decisions.
Thumbnail Image

Jade has experienced what unconscious gender bias feels like while looking for work

2020-12-02
Australian Broadcasting Corporation
Why's our monitor labelling this an incident or hazard?
The recruitment algorithms, which are AI systems, are shown to have biased outputs that disadvantage women, particularly those with caregiving breaks, leading to unfair hiring decisions. This bias results in violations of labor rights and gender discrimination, which are harms to human rights and labor rights as defined. The article provides evidence of realized harm through the discriminatory ranking and hiring practices influenced by AI, qualifying this as an AI Incident.
Thumbnail Image

Researchers find that even 'fair' hiring algorithms can be biased

2020-12-04
VentureBeat
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems (ranking algorithms used in hiring platforms) and their impact on human rights, specifically labor rights and non-discrimination in employment. The study documents realized biases and harms caused by these AI systems in hiring decisions, which affect underrepresented groups such as women and minorities. Since the article describes actual bias effects and their consequences on hiring outcomes, this constitutes an AI Incident under the framework, as the AI system's use has directly led to violations of labor rights and discriminatory harm. The article does not merely warn of potential harm but reports on observed bias and its impact, distinguishing it from a hazard or complementary information.
Thumbnail Image

Entry barriers for women are amplified by AI in recruitment algorithms, study finds

2020-12-02
Phys.org
Why's our monitor labelling this an incident or hazard?
The article explicitly discusses AI systems used in recruitment that mimic and amplify human gender biases, leading to women being unfairly disadvantaged despite equal qualifications. This constitutes a violation of labor rights and harms individuals' employment prospects, fitting the definition of an AI Incident. The harm is realized and ongoing, as the AI systems are actively used and shown to produce biased outcomes. Therefore, this event qualifies as an AI Incident rather than a hazard or complementary information.
Thumbnail Image

Job hiring algorithms bias and disadvantaging women

2020-12-02
Women's Agenda
Why's our monitor labelling this an incident or hazard?
The article explicitly discusses AI systems used in recruitment that, due to biased datasets and correlations, produce outputs disadvantaging female candidates. This leads to realized harm in the form of gender discrimination in hiring, which is a violation of labor rights and human rights. The AI's role is pivotal as it amplifies existing biases and affects hiring outcomes. Therefore, this qualifies as an AI Incident under the framework, as the AI system's use has directly or indirectly led to harm (discrimination) against a group of people (women).