Facebook's AI Algorithms Cause Emotional Distress by Resurfacing Painful Memories of Ex-Partners

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A study led by Anthony Pinter at the University of Colorado Boulder found that Facebook's AI-driven recommendation and memory algorithms repeatedly surface painful reminders of ex-partners, even after users block or mute them. This algorithmic insensitivity has caused emotional distress, highlighting the harm AI systems can inflict by failing to understand human relationships.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves an AI system (Facebook's recommendation and memory algorithms) whose use has indirectly led to harm—emotional distress to users due to unwanted reminders of ex-partners. The harm is realized and directly linked to the AI system's outputs. Therefore, this qualifies as an AI Incident under the definition of harm to people (emotional/psychological harm) caused by AI system use.[AI generated]
AI principles
AccountabilitySafetyTransparency & explainabilityDemocracy & human autonomy

Industries
Media, social platforms, and marketing

Affected stakeholders
Consumers

Harm types
Psychological

Business function:
Other

AI system task:
Organisation/recommenders


Articles about this incident or hazard