The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
ActionAid's research in Italy reveals that Instagram's AI recommendation algorithm rapidly suggests misogynistic and antifeminist content to male users, even when they search for unrelated topics like football. This AI-driven amplification normalizes gender-based hostility and violence, causing harm to communities and promoting toxic stereotypes.[AI generated]
Why's our monitor labelling this an incident or hazard?
The event explicitly involves AI systems in the form of social media recommendation algorithms that, through their use, have directly led to the spread of misogynistic and hateful content against women. This content causes harm to communities by promoting gender-based hostility and toxic stereotypes, fulfilling the criteria for harm under the AI Incident definition. The study's findings demonstrate realized harm rather than potential harm, and the AI system's role is pivotal in the dissemination of this content. Hence, the classification as an AI Incident is appropriate.[AI generated]