The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
An AI-generated illustration depicting a Black boy inside a recycling bin was included in official educational material distributed to third-grade students in Itapecerica da Serra, Brazil. The image caused widespread indignation for perpetuating racial stereotypes, prompting the municipality to withdraw the material and launch an internal investigation.[AI generated]
Why's our monitor labelling this an incident or hazard?
The AI system was used in the creation of the problematic illustration, which was then distributed in official educational materials, leading to realized harm in the form of racial discrimination and community harm. The harm is direct and materialized, not just potential. The event involves the use of AI in content generation that caused a violation of rights and harm to communities. The municipality's response and investigation are complementary information but do not negate the incident classification. Hence, the event is best classified as an AI Incident.[AI generated]