Facebook AI Labels Black Men as 'Primates', Sparks Outrage and Apology

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Facebook's AI-powered recommendation system mistakenly labeled videos featuring Black men as related to 'primates,' exposing significant racial bias in its algorithms. The incident led to public backlash, Facebook's apology, and the disabling of the feature while the company investigates the root cause.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event explicitly involves an AI system (Facebook's topic recommendation software) that malfunctioned by generating racially offensive content. This malfunction directly led to harm by perpetuating racial bias and causing offense to Black individuals, which falls under violations of human rights and harm to communities. The harm is realized, not just potential, making this an AI Incident rather than a hazard or complementary information.[AI generated]
AI principles
FairnessRespect of human rightsSafetyRobustness & digital securityAccountabilityTransparency & explainability

Industries
Media, social platforms, and marketing

Affected stakeholders
Consumers

Harm types
PsychologicalReputationalHuman or fundamental rights

Business function:
Other

AI system task:
Organisation/recommendersRecognition/object detection

In other databases

Articles about this incident or hazard