AI Recruitment Systems Cause Bias and Unfair Job Rejections

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Multiple companies are using AI systems to evaluate and select job candidates, often without human oversight. These systems, including those using personality games and automated assessments, have led to unfair rejections and documented bias, such as Amazon's AI discriminating against women, raising concerns about labor rights and discrimination in hiring.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly mentions AI systems used to evaluate job candidates and make hiring decisions without human oversight, which directly affects individuals' employment opportunities. The example of Amazon's AI system that was biased against women demonstrates realized harm and violation of labor rights. The AI's role in rejecting candidates without human review and the concerns about bias and fairness confirm that the AI system's use has directly led to harm. Hence, this is an AI Incident involving violations of labor rights and unfair treatment caused by AI recruitment systems.[AI generated]
AI principles
FairnessRespect of human rightsAccountabilityTransparency & explainability

Industries
Business processes and support services

Affected stakeholders
WomenWorkers

Harm types
Economic/PropertyPsychologicalHuman or fundamental rights

Severity
AI incident

Business function:
Human resource management

AI system task:
Forecasting/predictionGoal-driven organisation


Articles about this incident or hazard

Thumbnail Image

O que buscam os computadores que agora selecionam currículos - BBC News Brasil

2021-06-03
BBC
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI systems used to evaluate job candidates and make hiring decisions without human oversight, which directly affects individuals' employment opportunities. The example of Amazon's AI system that was biased against women demonstrates realized harm and violation of labor rights. The AI's role in rejecting candidates without human review and the concerns about bias and fairness confirm that the AI system's use has directly led to harm. Hence, this is an AI Incident involving violations of labor rights and unfair treatment caused by AI recruitment systems.
Thumbnail Image

O que buscam os computadores que agora selecionam currículos - 03/06/2021 - Carreiras - Folha

2021-06-03
Folha de S.Paulo
Why's our monitor labelling this an incident or hazard?
The AI systems described are explicitly involved in evaluating and selecting job candidates, directly affecting their employment outcomes. This use of AI in recruitment can lead to violations of labor rights and discrimination, which are harms under the framework. The article reports on actual use cases where AI systems have made hiring decisions without human oversight, and references known incidents of bias causing harm. Therefore, this qualifies as an AI Incident due to realized harm linked to AI use in recruitment.
Thumbnail Image

O que buscam os computadores que agora selecionam currículos

2021-06-03
Terra
Why's our monitor labelling this an incident or hazard?
The AI systems described are explicitly used to approve or reject job candidates, directly impacting their employment prospects. The article provides evidence of realized harm, such as the Amazon AI system's gender bias leading to unfair treatment of female candidates. The AI's role in decision-making without human oversight and the potential for bias and unfairness constitute violations of labor rights and human rights. Hence, this event qualifies as an AI Incident due to direct harm caused by AI use in recruitment.
Thumbnail Image

O que buscam os computadores que agora selecionam currículos

2021-06-03
Correio Braziliense
Why's our monitor labelling this an incident or hazard?
The article explicitly describes AI systems used in recruitment that evaluate candidates and make decisions without human oversight, leading to potential unfair rejection or approval. This impacts candidates' labor rights and fairness in employment, which is a violation of human rights and labor rights under the framework. The example of Amazon's AI system exhibiting gender bias and being abandoned confirms that harm has occurred. The AI's role is pivotal in these harms, as the systems' outputs directly influence hiring decisions. Hence, this qualifies as an AI Incident due to realized harm from AI use in recruitment.
Thumbnail Image

A fundamentação da decisão e a inteligência artificial no Direito Penal

2021-06-05
ConJur - Consultor Jurídico
Why's our monitor labelling this an incident or hazard?
The text explicitly references AI systems used in judicial contexts and discusses the risks of bias and harm to fundamental rights if AI decisions are not properly controlled and justified. These concerns relate to potential violations of human rights and fundamental legal guarantees. However, the article is a scholarly and normative discussion without describing a concrete AI Incident (actual harm caused) or AI Hazard (a specific event plausibly leading to harm). It also does not focus on updates or responses to prior incidents, so it is not Complementary Information. Therefore, the article is best classified as Complementary Information because it provides important context, analysis, and governance considerations about AI's role and risks in the legal system, enhancing understanding but not reporting a new incident or hazard.
Thumbnail Image

AI is taking over job hiring, but can it be racist? - ET CIO

2021-06-07
ETCIO.com
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI systems used in hiring that have caused harm by discriminating against applicants based on race and other factors, leading to unfair rejections and reinforcing systemic bias. This is a clear example of an AI Incident because the AI's use has directly led to violations of labor rights and discrimination, which are harms under the OECD framework. The discussion of regulatory responses and calls for audits further supports that harm has already occurred and is recognized. Therefore, the event qualifies as an AI Incident rather than a hazard or complementary information.
Thumbnail Image

How racist robots are being used in recruitment

2021-06-07
The Independent
Why's our monitor labelling this an incident or hazard?
The article explicitly involves AI systems used in recruitment, including resume screening and video interview analysis AI. These systems have directly or indirectly led to harm by perpetuating racial and gender biases, resulting in discriminatory hiring practices and violations of labor and human rights. The harm is realized, as evidenced by documented cases and personal testimonies. The article also discusses regulatory responses but focuses primarily on the harm caused by these AI systems. Hence, this is an AI Incident rather than a hazard or complementary information.
Thumbnail Image

AI is taking over job hiring, but can it be racist?

2021-06-07
bdnews24.com
Why's our monitor labelling this an incident or hazard?
The article clearly describes AI systems used in hiring that have directly or indirectly caused harm by perpetuating racial and gender bias, which constitutes violations of labor and human rights. Examples include Amazon's AI resume screener penalizing women’s colleges and concerns from minority applicants about unfair automated rejections. The harms are realized and ongoing, not merely potential. The involvement of AI in these discriminatory outcomes is explicit and central to the narrative. Hence, the event meets the criteria for an AI Incident rather than a hazard or complementary information.
Thumbnail Image

AI is taking over job hiring, but racism concerns persist

2021-06-07
The Japan Times
Why's our monitor labelling this an incident or hazard?
The event involves AI systems used in hiring that have directly led to violations of labor and human rights through biased and discriminatory outcomes against minority applicants. The harms are realized, as applicants like Kevin Carballo experience automated rejections likely influenced by biased AI algorithms. The article documents these harms and the systemic issues in AI hiring tools, meeting the criteria for an AI Incident due to violations of rights and harm to individuals and communities. The discussion of regulatory responses and calls for stronger protections further supports the classification as an AI Incident rather than merely a hazard or complementary information.
Thumbnail Image

AI is taking over job hiring, but can it be racist? - analysis

2021-06-07
The Jerusalem Post
Why's our monitor labelling this an incident or hazard?
The article explicitly involves AI systems used in hiring, which directly impact individuals by potentially causing discriminatory harm, a violation of labor and human rights. The AI systems' use in screening and assessing candidates has led to real-world harm, such as unfair rejections based on biased algorithms. This fits the definition of an AI Incident because the AI system's use has directly led to violations of rights and harm to individuals and communities. The discussion of regulatory responses and calls for audits complements the incident but does not overshadow the primary focus on realized harm caused by AI in hiring.
Thumbnail Image

Artificial Intelligence is taking over job hiring, but can it be

2021-06-07
Deccan Herald
Why's our monitor labelling this an incident or hazard?
The article explicitly involves AI systems used in hiring that have caused or are causing harm through biased and discriminatory outcomes, which are violations of labor and human rights. The harm is realized as job applicants from minority or disadvantaged backgrounds face unfair rejection due to AI screening. The article provides concrete examples and testimonies illustrating these harms. It also discusses regulatory responses, but the primary focus is on the harm caused by AI use in hiring. Hence, this is an AI Incident rather than a hazard or complementary information.
Thumbnail Image

AI is taking over job hiring, but can it be racist?

2021-06-07
National Post
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI systems used in hiring that assess applicants and potentially lock in racial discrimination and biases. This constitutes a violation of labor rights and discrimination against protected groups, which is a recognized harm under the AI Incident definition. The harm is occurring as applicants are being unfairly rejected based on biased AI assessments. Hence, this qualifies as an AI Incident due to the realized harm caused by the AI systems' use in hiring.
Thumbnail Image

Beat The Bots: Employer Risk In Delegating Hiring Practices To Artificial Intelligence -- A Dilemma Worth Solving - Coronavirus (COVID-19) - United States

2021-06-10
Mondaq Business Briefing
Why's our monitor labelling this an incident or hazard?
The article clearly involves AI systems used in hiring (AI System involvement). It discusses the use and potential misuse of AI in hiring, including bias and privacy issues, which could lead to violations of rights and ethical concerns. However, it does not describe a specific event where harm has occurred or is occurring. The HireVue case mentioned is a complaint and dispute, not a confirmed incident of harm. The article is more about raising awareness of risks and legal considerations, making it a discussion of potential hazards and governance rather than a report of an AI Incident. Since it does not focus on a new or ongoing incident or hazard but rather on the broader context and implications, it fits best as Complementary Information.
Thumbnail Image

Legislators worldwide mull use of AI in recruitment to weed out discrimination

2021-06-07
BusinessLIVE
Why's our monitor labelling this an incident or hazard?
The article explicitly describes AI systems used in recruitment that have directly led to discriminatory outcomes against certain groups, such as ethnic minorities and women, which is a violation of labor rights and human rights. Examples include Amazon's AI resume screener penalizing resumes with the word "women" and concerns from job seekers about bias in AI assessments. These harms are realized and ongoing, not merely potential. Therefore, this qualifies as an AI Incident due to violations of rights caused by AI system use in hiring.
Thumbnail Image

AI is taking over job hiring, but can it be racist?

2021-06-07
Thomson Reuters Foundation News
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI systems used in hiring that have directly led to discriminatory outcomes, which constitute violations of labor rights and human rights. The harms are realized and ongoing, as applicants like Kevin Carballo experience automated rejections likely influenced by biased AI algorithms. The discussion of regulatory efforts and calls for audits further supports that these harms are materialized and recognized. Therefore, this event qualifies as an AI Incident due to the direct and indirect harm caused by biased AI hiring systems.
Thumbnail Image

Robots have turned interviewers. But can machines accurately and fairly judge a person?

2021-06-16
Economic Times
Why's our monitor labelling this an incident or hazard?
The article explicitly discusses AI systems used in hiring that assess candidates and influence hiring decisions. It documents realized harms such as candidates being rejected without explanation and concerns about bias against protected groups, which are violations of rights and fairness. The AI systems' role in screening and ranking candidates directly impacts individuals' employment opportunities, causing harm. Therefore, this qualifies as an AI Incident due to realized harm linked to AI use in hiring and discrimination risks.
Thumbnail Image

Want a job? Employers say: Talk to the computer

2021-06-15
NBC News
Why's our monitor labelling this an incident or hazard?
The event involves AI systems used in hiring decisions, which have directly led to harm in the form of potential discrimination and unfair treatment of job applicants, including racial and gender bias. The AI's role is pivotal as it influences who is selected or rejected without transparency, impacting individuals' employment opportunities and rights. This fits the definition of an AI Incident because the AI system's use has directly led to violations of labor rights and potential discrimination, constituting harm to individuals and communities. The article also discusses regulatory responses and company actions, but the primary focus is on the harm caused by AI hiring systems.
Thumbnail Image

Want a job? Employers say: Talk to the computer | The China Post, Taiwan

2021-06-15
The China Post, Taiwan
Why's our monitor labelling this an incident or hazard?
The article explicitly discusses AI systems used in hiring processes that analyze candidate responses and behavior to make decisions affecting employment opportunities. It reports real cases where candidates were rejected after AI-driven interviews without clear feedback, raising concerns about bias and fairness. This constitutes an AI Incident because the AI system's use has directly led to harm in the form of potential discriminatory hiring practices and lack of transparency, impacting individuals' labor rights and fair treatment. The article also references regulatory responses and audits, but the primary focus is on the realized harms from AI hiring systems.
Thumbnail Image

US companies are using AI to screen jobseekers - experts aren't convinced

2021-06-16
Stuff
Why's our monitor labelling this an incident or hazard?
The article explicitly discusses AI systems used in hiring processes that analyze candidates' speech and behavior to make decisions about their suitability for jobs. These AI systems have directly influenced hiring outcomes, leading to candidates being rejected without clear reasons and raising concerns about bias against minorities and women. Such outcomes represent violations of labor rights and potentially human rights due to discriminatory practices. Therefore, the event qualifies as an AI Incident because the AI system's use has directly led to harm through unfair and opaque hiring decisions.
Thumbnail Image

Want a job? Employers say: Talk to the computer

2021-06-16
Star Tribune
Why's our monitor labelling this an incident or hazard?
The event involves AI systems used in hiring decisions, where the AI's use has directly led to harm in the form of unfair rejection of candidates and potential violations of labor and anti-discrimination rights. The AI systems' opaque decision-making processes and possible biases have caused real harm to individuals seeking employment, fulfilling the criteria for an AI Incident. The article documents actual cases of harm and systemic issues rather than just potential risks or responses, so it is not merely Complementary Information or an AI Hazard.
Thumbnail Image

Want a job? Employers say, talk to a computer

2021-06-15
Chicago Sun-Times
Why's our monitor labelling this an incident or hazard?
The article involves AI systems used in hiring and their potential to cause harm through biased or unfair assessments, which could violate labor and human rights. However, it does not describe a concrete event where harm has already occurred due to these AI systems. Instead, it discusses concerns, criticisms, and regulatory proposals related to these AI hiring tools. Therefore, the event is best classified as Complementary Information, as it provides context, societal and governance responses, and ongoing debates about AI's impact on hiring fairness without reporting a specific AI Incident or imminent AI Hazard.
Thumbnail Image

Want a job? Employers say: Talk to the computer | WTOP

2021-06-15
WTOP
Why's our monitor labelling this an incident or hazard?
The article explicitly involves AI systems used in hiring processes, fulfilling the AI System criterion. It discusses the use of AI in evaluating candidates and the potential for bias and discrimination, which are recognized harms under violations of labor and human rights. However, the article does not document a specific AI Incident where harm has directly or indirectly occurred; instead, it focuses on concerns, critiques, regulatory proposals, and company responses. This aligns with the definition of Complementary Information, as it provides updates and context on AI's societal impact and governance without reporting a new incident or hazard. Hence, the classification is Complementary Information.
Thumbnail Image

Want a job? Employers say: Talk to the computer

2021-06-15
Daily Herald
Why's our monitor labelling this an incident or hazard?
The event involves AI systems used in hiring processes that have directly led to harm in the form of potential violations of labor rights and discrimination against candidates, such as racial and gender bias. The AI's role in screening and evaluating candidates has caused real negative impacts on individuals' job prospects, which constitutes harm to persons and breaches of rights. Therefore, this qualifies as an AI Incident rather than a hazard or complementary information, as the harm is realized and linked to the AI system's use.
Thumbnail Image

Want a job? Employers say: Talk to the computer

2021-06-15
stamford advocate
Why's our monitor labelling this an incident or hazard?
The event involves AI systems used in hiring decisions, which directly impact individuals' employment opportunities, a fundamental labor right. The AI's use in assessing candidates has led to realized harms such as potential discrimination and unfair treatment, as evidenced by candidates' experiences and expert critiques. The opacity of the AI decision-making process and the documented biases in these systems fulfill the criteria for an AI Incident under violations of human rights and labor rights. The article does not merely discuss potential risks but reports on actual use and harm occurring, making it an AI Incident rather than a hazard or complementary information.
Thumbnail Image

Want a job? Employers say: Talk to the computer | Federal News Network

2021-06-15
Federal News Network
Why's our monitor labelling this an incident or hazard?
The event involves AI systems used in hiring decisions, where the AI's use has directly led to harm in the form of potential violations of labor rights and discrimination against candidates, particularly minorities and women. The harm includes unfair rejection without explanation and possible bias embedded in AI assessments. Since these harms are occurring and linked to the AI systems' use, this qualifies as an AI Incident under the framework, specifically under violations of human rights and labor rights (c).
Thumbnail Image

Want a job? Employers say: Talk to the computer

2021-06-15
KOB 4
Why's our monitor labelling this an incident or hazard?
The article explicitly discusses AI systems used in hiring that analyze candidate speech and facial expressions to make decisions affecting employment opportunities. It reports on real cases where candidates were rejected without clear explanations, raising concerns about bias and unfair treatment, which are harms to individuals and potentially violations of labor and anti-discrimination rights. The AI system's use in these hiring decisions has directly led to these harms. Therefore, this event qualifies as an AI Incident under the framework, as the AI system's use has directly led to violations of rights and harm to people.
Thumbnail Image

Want a job? Employers say: Talk to the computer

2021-06-15
WKOW
Why's our monitor labelling this an incident or hazard?
The article describes AI systems used in hiring processes that analyze candidates' speech and language, which qualifies as AI system involvement. However, it does not report any realized harm or incident resulting from these systems, only concerns and calls for transparency. Therefore, it represents a plausible risk of harm (e.g., discrimination) but no confirmed incident. This fits the definition of an AI Hazard, as the technology could plausibly lead to violations of rights or unfair treatment if not properly managed.
Thumbnail Image

Want a job? Employers say: Talk to the computer

2021-06-15
Sioux City Journal
Why's our monitor labelling this an incident or hazard?
The event involves AI systems explicitly used in hiring decisions, which have directly led to harm by potentially discriminating against candidates based on race, gender, or other protected characteristics, thus violating labor and human rights. The article provides concrete examples of individuals rejected after AI-based interviews without transparency or recourse, indicating realized harm. The concerns about bias and unfairness, along with regulatory scrutiny, confirm that these AI systems' use has caused violations of rights and harm to individuals. Therefore, this qualifies as an AI Incident under the framework, as the AI system's use has directly led to harm in employment and human rights contexts.