Generative AI Tools Produce Racist and Sexist Stereotypes in Australian Imagery

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Researchers from Curtin University found that leading generative AI image tools, including Dall-E 3 and Midjourney, consistently produced images of Australians and Australia that perpetuate racist and sexist stereotypes, reinforcing harmful cultural biases and misrepresentations. These biased outputs cause harm to communities and violate cultural rights.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly involves generative AI systems producing images that embody racist and sexist stereotypes, which constitutes harm to communities and violations of rights. The harms are not hypothetical but are occurring as the AI tools generate and distribute these biased images. The study documents these harms with concrete examples, showing the AI's outputs perpetuate harmful cultural and racial caricatures. This meets the criteria for an AI Incident because the AI system's use directly leads to significant harm to communities and breaches of rights. The event is not merely a potential risk or a complementary update but a documented case of harm caused by AI outputs.[AI generated]
AI principles
FairnessRespect of human rightsHuman wellbeingAccountabilityTransparency & explainabilitySafety

Industries
Media, social platforms, and marketingArts, entertainment, and recreation

Affected stakeholders
General publicWomen

Harm types
Human or fundamental rightsPsychologicalReputational

AI system task:
Content generation


Articles about this incident or hazard