Israel's 'Red Wolf' Facial Recognition System Automates Restrictions on Palestinians

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Israeli authorities are using an AI-powered facial recognition system, Red Wolf, to monitor and restrict Palestinians' movement at checkpoints in the West Bank and East Jerusalem. Amnesty International reports the technology automates segregation, expands biometric databases, and entrenches human rights violations, amounting to 'automated apartheid' against Palestinians.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly describes an AI system (facial recognition software) being used to identify and control Palestinians, leading to direct harm in the form of human rights violations and discriminatory treatment. The AI system's outputs guide soldiers' decisions on whether to allow passage, stop for questioning, or arrest individuals, which constitutes direct involvement in harm. The surveillance and control are targeted at an ethnic group, constituting a breach of fundamental rights. Therefore, this qualifies as an AI Incident under the framework, as the AI system's use has directly led to violations of human rights and harm to communities.[AI generated]
AI principles
AccountabilityFairnessHuman wellbeingPrivacy & data governanceRespect of human rightsRobustness & digital securitySafetyTransparency & explainabilityDemocracy & human autonomy

Industries
Government, security, and defenceDigital security

Affected stakeholders
General public

Harm types
Human or fundamental rightsPsychologicalEconomic/PropertyPublic interest

Business function:
Compliance and justiceMonitoring and quality control

AI system task:
Recognition/object detectionGoal-driven organisation


Articles about this incident or hazard