Meta's AI Image Generator Criticized for Racial Bias in Depicting Mixed-Race Couples

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Meta's AI image generator has been widely criticized for failing to accurately create images of mixed-race couples, often defaulting to same-race pairings despite specific prompts. Users and reporters found the tool repeatedly excluded or misrepresented interracial relationships, raising concerns about racial bias and discrimination in AI-generated content.[AI generated]

Why's our monitor labelling this an incident or hazard?

The AI system (Meta's image generator) is involved in generating images based on text prompts. The event describes the AI's failure to accurately represent interracial couples involving an Asian man and a white woman, indicating a bias or limitation in the AI's training or generation process. This results in a form of representational harm, which can be considered a violation of rights related to fair and accurate representation, thus fitting the definition of an AI Incident due to harm to communities and potential violation of rights.[AI generated]
AI principles
FairnessRespect of human rightsTransparency & explainabilityAccountabilityHuman wellbeing

Industries
Media, social platforms, and marketing

Affected stakeholders
Consumers

Harm types
Human or fundamental rightsPsychologicalReputational

Severity
AI incident

Business function:
Other

AI system task:
Content generation

In other databases

Articles about this incident or hazard

Thumbnail Image

Meta's AI image generator can't imagine an Asian man with a white woman

2024-04-03
The Verge
Why's our monitor labelling this an incident or hazard?
The AI system (Meta's image generator) is involved in generating images based on text prompts. The event describes the AI's failure to accurately represent interracial couples involving an Asian man and a white woman, indicating a bias or limitation in the AI's training or generation process. This results in a form of representational harm, which can be considered a violation of rights related to fair and accurate representation, thus fitting the definition of an AI Incident due to harm to communities and potential violation of rights.
Thumbnail Image

AI-generated Asians were briefly unavailable on Instagram

2024-04-04
The Verge
Why's our monitor labelling this an incident or hazard?
An AI system (the Instagram AI image generator) is explicitly involved. The system's malfunction or bias led to inaccurate and potentially harmful racial representations, which can be considered harm to communities through misrepresentation and perpetuation of racial bias. Although no physical injury or direct legal violation is reported, the harm to community representation and potential violation of rights related to fair and accurate portrayal is present. Therefore, this qualifies as an AI Incident due to the realized harm caused by the AI system's outputs and failure.
Thumbnail Image

Meta's AI image generator struggles to create images of couples of different races

2024-04-03
engadget
Why's our monitor labelling this an incident or hazard?
The event involves an AI system (Meta's AI image generator) whose outputs demonstrate biased behavior, specifically racial bias, which can be considered a violation of human rights or a harm to communities by perpetuating stereotypes and misrepresentations. The bias is realized in the system's use, leading to inaccurate and potentially harmful depictions. Therefore, this qualifies as an AI Incident due to the direct harm caused by biased AI outputs affecting representation and potentially reinforcing societal biases.
Thumbnail Image

Meta's AI Image Generator Will Not Depict an Asian Man With a White Woman

2024-04-04
Gizmodo
Why's our monitor labelling this an incident or hazard?
The event involves an AI system (Meta's AI-powered image generator) whose outputs demonstrate racial bias, a form of harm to communities and a violation of rights. The AI system's use has directly led to this harm by producing biased and exclusionary images. Therefore, this qualifies as an AI Incident under the framework, as the AI system's use has directly led to harm related to racial bias and discrimination.
Thumbnail Image

Meta's AI image generator really struggles with the concept of interracial couples | CNN Business

2024-04-04
CNN
Why's our monitor labelling this an incident or hazard?
The AI system is explicitly involved as Meta's AI image generator, which is used to create images. The event describes the AI's failure to accurately represent interracial couples, which is a form of bias and discrimination. This bias can cause harm to communities by reinforcing racial stereotypes and exclusion, thus constituting harm under the framework. The harm is realized as the biased outputs are generated and disseminated, not merely potential. Therefore, this qualifies as an AI Incident due to violation of rights and harm to communities caused by the AI system's biased outputs.
Thumbnail Image

How Meta's AI-powered image tool may have 'Google Gemini problem' - Times of India

2024-04-04
The Times of India
Why's our monitor labelling this an incident or hazard?
The AI systems involved are image generators that use AI to create images based on prompts. The reported biases and inaccuracies in representing racial diversity constitute a form of harm to communities and potentially a violation of rights related to fair representation. Since these harms are occurring through the use of these AI systems, this qualifies as an AI Incident. The article details realized harm (biased outputs causing misrepresentation), not just potential harm, and thus it is not merely a hazard or complementary information.
Thumbnail Image

Mark Zuckerberg is married to a Chinese-American woman, but Meta's AI image generator can't imagine an Asian man with a white woman

2024-04-06
Business Insider
Why's our monitor labelling this an incident or hazard?
The AI system (Meta's image generator) is explicitly mentioned and is shown to produce biased outputs that exclude or misrepresent certain racial combinations. This constitutes a violation of rights and harm to communities through stereotyping and exclusion, which fits the definition of an AI Incident. The harm is realized as the AI's outputs demonstrate the bias, not just a potential risk. Therefore, this event qualifies as an AI Incident due to the direct harm caused by the AI system's biased behavior.
Thumbnail Image

Meta's AI image generator can't seem to grasp the idea that interracial couples exist

2024-04-05
Business Insider
Why's our monitor labelling this an incident or hazard?
The AI system is explicitly involved as the image-generation tool producing biased or inaccurate representations of interracial couples. This bias can be considered a violation of rights related to fair and accurate representation, potentially causing harm to communities by reinforcing stereotypes or exclusion. However, the article describes the issue as a current malfunction or limitation in the AI's outputs rather than a direct incident causing realized harm such as injury or legal violations. The harm is more subtle and systemic, relating to bias and misrepresentation, which fits the definition of an AI Incident due to violation of rights and harm to communities through biased outputs.
Thumbnail Image

Meta's AI chatbot refuses to imagine an Asian man with a white woman

2024-04-04
Daily Mail Online
Why's our monitor labelling this an incident or hazard?
The event involves an AI system (Meta's AI image generator) whose use has directly led to harm through racial bias and stereotyping in generated images. The AI's inability to generate certain mixed-race images and its stereotypical portrayals contribute to social harm and potential violations of rights related to representation and discrimination. This meets the criteria for an AI Incident because the AI's outputs have caused realized harm to communities and individuals by reinforcing harmful biases and exclusion.
Thumbnail Image

Meta's AI image generator won't create photo of Asian dating white...

2024-04-05
New York Post
Why's our monitor labelling this an incident or hazard?
The AI system (Meta's Imagine) is explicitly mentioned as the source of biased image generation, which is a direct use of the AI system leading to harm. The harm involves discriminatory bias and misrepresentation, which can be classified as harm to communities and a violation of rights. The article documents realized harm through the AI's refusal to generate certain interracial images, not just a potential or hypothetical risk. Hence, this is an AI Incident rather than a hazard or complementary information.
Thumbnail Image

Mark Zuckerberg is married to a Chinese-American woman, but Meta's AI image generator can't imagine an Asian man with a white woman

2024-04-06
Business Insider India
Why's our monitor labelling this an incident or hazard?
The AI system (Meta's Imagine) is explicitly involved as it generates images based on prompts. The event highlights a failure in the AI's outputs that results in racial bias, which is a form of harm to communities and a violation of rights related to fair and accurate representation. Since the bias is realized and users have observed the discriminatory outputs, this constitutes an AI Incident rather than a potential hazard or complementary information. The harm is indirect but clearly linked to the AI system's development and use.
Thumbnail Image

Meta's AI image generator can't seem to grasp the idea that interracial couples exist

2024-04-05
Business Insider India
Why's our monitor labelling this an incident or hazard?
The AI system (Meta's image generator) is explicitly involved and is malfunctioning or biased in its output generation, leading to inaccurate and exclusionary representations of interracial couples. This constitutes a harm to communities by perpetuating racial bias and misrepresentation. Since the harm is realized in the biased outputs and their social implications, this qualifies as an AI Incident under the framework, specifically under harm to communities and potential violation of rights related to discrimination.
Thumbnail Image

Meta's AI Tool Finds Itself in Trouble as It Inaccurately Creates Images of a Mixed-Race Couple

2024-04-04
Wccftech
Why's our monitor labelling this an incident or hazard?
The event involves an AI system (Meta's AI image generator) that is malfunctioning by producing inaccurate images, which could be inferred as a bias issue. However, the article does not describe any realized harm such as injury, rights violations, or disruption caused by these inaccuracies. The harm is limited to poor performance and potential bias, which while concerning, does not meet the threshold for an AI Incident. There is also no indication that this issue has plausibly led or could plausibly lead to significant harm beyond the current inaccuracies. Therefore, this event is best classified as Complementary Information, as it provides context and updates on the AI system's current limitations and ongoing beta status without reporting a concrete incident of harm.
Thumbnail Image

Meta's AI image generator accused of racism

2024-04-05
The Sunday Times
Why's our monitor labelling this an incident or hazard?
The AI system (Meta's image generator) is explicitly involved and its use has led to discriminatory outputs that exclude or misrepresent interracial couples. This constitutes a violation of human rights principles related to equality and non-discrimination, which falls under harm category (c) - violations of human rights or breach of obligations intended to protect fundamental rights. Since the bias is realized in the system's outputs and affects users, this is an AI Incident rather than a potential hazard or complementary information.
Thumbnail Image

Meta's image generator has a problem with (some) mixed-race couples and friends

2024-04-03
VentureBeat
Why's our monitor labelling this an incident or hazard?
The AI system (Meta's image generator) is explicitly involved and its use has led to biased and stereotypical image outputs that misrepresent mixed-race couples and friends. This constitutes a violation of human rights in terms of reinforcing racial and cultural stereotypes and potentially causing harm to communities by perpetuating inaccurate and exclusionary representations. The harm is realized through the AI's outputs and their social implications, making this an AI Incident rather than a mere hazard or complementary information.
Thumbnail Image

Meta's AI Refuses to Show Asian Men With White Women

2024-04-04
Futurism
Why's our monitor labelling this an incident or hazard?
The AI system (Meta's Imagine) is explicitly involved as it generates images based on prompts. The event describes a bias in the AI's outputs related to race and interracial relationships, which is a form of harm to communities by reinforcing racial stereotypes and exclusion. Although the harm is non-physical, it affects social perceptions and can contribute to discrimination. The bias is a direct consequence of the AI system's training and use, thus constituting an AI Incident under violations of rights and harm to communities. The article describes realized harm through biased outputs, not just potential harm.
Thumbnail Image

Meta's AI Image Maker Has a Problem with Mixed Race Couples

2024-04-04
PetaPixel
Why's our monitor labelling this an incident or hazard?
The event involves an AI system (Meta's AI image generator) whose use has led to biased and stereotypical representations of mixed-race couples, which can be considered a violation of human rights or a harm to communities by reinforcing harmful racial stereotypes and erasing cultural diversity. Although the harm is non-physical, it is significant and clearly articulated as a form of representational harm and bias. Therefore, this qualifies as an AI Incident due to the AI system's outputs directly leading to these harms.
Thumbnail Image

Instagram's AI Image Generator Faces Racial Representation Errors

2024-04-05
Tech Times
Why's our monitor labelling this an incident or hazard?
The article explicitly discusses an AI system (Instagram's AI image generator) malfunctioning in its use, producing racially biased and inaccurate images, which constitutes harm to communities through misrepresentation and bias. The errors and biases are direct consequences of the AI system's outputs, fulfilling the criteria for an AI Incident. The harm is realized as users experience errors and biased representations, not merely a potential risk. Therefore, this event qualifies as an AI Incident.
Thumbnail Image

Meta's AI program can't create images of Asian men with white women, called 'racist'

2024-04-04
Toronto Sun
Why's our monitor labelling this an incident or hazard?
The AI system (image generator) is explicitly involved and its outputs demonstrate biased or discriminatory behavior, which constitutes a violation of human rights or ethical standards related to racial representation. Although no direct physical harm is reported, the biased outputs can cause harm to communities by perpetuating racial stereotypes and exclusion, which fits within the scope of AI Incident under violations of human rights or harm to communities. Therefore, this event qualifies as an AI Incident due to the realized harm of biased AI outputs affecting social perceptions and rights.
Thumbnail Image

Meta's AI tool struggles to create images of interracial couples

2024-04-04
NewsBytes
Why's our monitor labelling this an incident or hazard?
The AI system's outputs demonstrate biased representations and stereotyping, which can be considered harm to communities by perpetuating inaccurate and potentially harmful social stereotypes. Since the AI system's use has directly led to these biased and harmful outputs, this qualifies as an AI Incident under the framework's definition of harm to communities.
Thumbnail Image

Meta's AI image generator fails badly with multiracial requests

2024-04-04
MobileSyrup
Why's our monitor labelling this an incident or hazard?
The AI system involved is Meta's image generation tool, which is explicitly described as generating images based on user prompts. The incident involves the AI's failure to correctly represent multiracial individuals as requested, repeatedly producing images that do not match the racial diversity specified. This constitutes a violation of human rights in terms of racial representation and can be considered harm to communities by perpetuating stereotypes and exclusion. Since the harm is realized and directly linked to the AI system's outputs, this qualifies as an AI Incident under the framework.
Thumbnail Image

Meta's AI tool inaccurately creates images of mixed-race couples

2024-04-04
Android Headlines
Why's our monitor labelling this an incident or hazard?
The event involves an AI system (Meta's AI image generator) whose outputs are biased and inaccurate, leading to misrepresentation of racial groups. This constitutes a violation of rights related to fair and accurate representation, which can be considered harm to communities and a breach of ethical standards. Although the harm is non-physical, it is significant and clearly articulated, stemming directly from the AI system's use. Therefore, this qualifies as an AI Incident under the framework.
Thumbnail Image

Meta's AI image generator can't seem to grasp the idea that interracial couples exist

2024-04-05
Business Insider Nederland
Why's our monitor labelling this an incident or hazard?
The event involves an AI system (Meta's AI image generator) whose outputs demonstrate biased or inaccurate representation of interracial couples, which is a form of harm related to discrimination and misrepresentation. This constitutes a violation of rights related to fair and accurate representation, impacting communities and potentially reinforcing harmful stereotypes. Since the AI system's use has directly led to this harm, this qualifies as an AI Incident under the framework.
Thumbnail Image

Mark Zuckerberg is married to a Chinese-American woman, but Meta's AI image generator can't imagine an Asian man with a white woman

2024-04-06
Business Insider Nederland
Why's our monitor labelling this an incident or hazard?
The event involves an AI system (Meta's Imagine) whose use has directly led to biased and exclusionary outputs that reinforce racial stereotypes. This constitutes harm to communities and a violation of rights to fair and accurate representation. The AI's failure to generate images of mixed-race couples is a direct consequence of its training data and model behavior, thus qualifying as an AI Incident under the framework because the harm is realized and linked to the AI system's use.
Thumbnail Image

Meta AI Image Generator Glitch: Users Report Issues Generating Interracial Images

2024-04-05
International Business Times UK
Why's our monitor labelling this an incident or hazard?
The AI system (Meta's AI image generator) is explicitly involved, as it is generating images based on user prompts. The event stems from the AI system's use, where its biased outputs have led to social harm by reinforcing racial stereotypes and exclusion, which can be considered harm to communities and a violation of rights related to equality and non-discrimination. The harm is realized as users report and criticize the AI's biased behavior, making this an AI Incident rather than a mere hazard or complementary information. The article also discusses similar issues with Google's Gemini AI, reinforcing the significance of the harm caused by biased AI image generation.
Thumbnail Image

Meta's AI image generator really struggles with the concept of interracial couples

2024-04-04
WSIL
Why's our monitor labelling this an incident or hazard?
The AI system is explicitly involved as Meta's AI image generator. The event describes the AI's failure to accurately represent interracial couples, which is a form of bias and discrimination. This bias can cause harm to communities by reinforcing racial stereotypes and exclusion, thus constituting harm to communities and a violation of rights. The harm is realized as the AI system is actively producing biased outputs. Therefore, this qualifies as an AI Incident due to the direct role of the AI system in causing harm through biased representation.
Thumbnail Image

Meta's image generator has a problem with (some) mixed-race couples and friends - RocketNews

2024-04-03
RocketNews | Top News Stories From Around the Globe
Why's our monitor labelling this an incident or hazard?
The event involves an AI system (Meta's image generator) whose outputs are biased and inaccurate regarding mixed-race couples. This is a direct use of the AI system leading to a form of harm related to misrepresentation and potential violation of rights to fair and accurate representation, which can be considered harm to communities or a violation of rights. The harm is realized as the AI system repeatedly fails to generate accurate images, thus causing harm through exclusion and misrepresentation. Therefore, this qualifies as an AI Incident.
Thumbnail Image

Meta's AI image generator struggles to conceive of an Asian man with a white woman - Softonic

2024-04-05
Softonic
Why's our monitor labelling this an incident or hazard?
The event involves an AI system (Meta's AI image generator) whose outputs demonstrate bias and misrepresentation of racial and ethnic identities. This bias can be considered a violation of human rights or a breach of obligations intended to protect fundamental rights, as it perpetuates harmful stereotypes and misrepresents racial groups. Although the harm is non-physical, it affects communities and individuals by reinforcing biased perceptions and exclusion. Therefore, this qualifies as an AI Incident due to the realized harm in biased representation and its societal implications.
Thumbnail Image

Meta's AI tool accused of being 'racist'

2024-04-05
Business Plus
Why's our monitor labelling this an incident or hazard?
The AI system is explicitly involved as the image generator developed by Meta. The harm arises from the AI's biased outputs that exclude or misrepresent mixed-race couples, which can perpetuate racial stereotypes and discrimination, constituting harm to communities and a violation of rights. The article reports realized harm through biased AI behavior, not just potential harm. Therefore, this qualifies as an AI Incident due to the direct link between the AI system's use and the harm caused by racial bias in generated images.
Thumbnail Image

Zuckerberg's Wife Is Chinese-American -- Meta's AI Image Generator Can't Cope - Today Headline

2024-04-06
TodayHeadline
Why's our monitor labelling this an incident or hazard?
The AI system (Meta's image generator) is explicitly involved and its use has led to biased outputs that exclude or misrepresent certain racial groups, which constitutes harm to communities and a violation of rights. The harm is realized as users experience and report the biased outputs. Therefore, this qualifies as an AI Incident due to the direct role of the AI system in producing discriminatory content.
Thumbnail Image

AI của Meta loạn màu da khi tạo ảnh

2024-04-09
vnexpress.net
Why's our monitor labelling this an incident or hazard?
The AI system (Meta's Imagine) is explicitly involved and is malfunctioning or biased in its image generation, leading to inaccurate and racially biased outputs. This constitutes harm to communities and a violation of rights related to racial representation and fairness. The harm is realized as the AI system is actively producing biased images, not just a potential risk. Therefore, this qualifies as an AI Incident under the framework.
Thumbnail Image

Meta gắn nhãn cho các nội dung do AI tạo ra

2024-04-06
TUOI TRE ONLINE
Why's our monitor labelling this an incident or hazard?
The article describes Meta's plan to label AI-generated content to increase transparency and reduce misinformation risks. This is a policy and governance action rather than a report of an AI Incident or AI Hazard. There is no direct or indirect harm described as having occurred, nor a specific plausible harm event. Therefore, it fits the definition of Complementary Information, as it provides context and response to AI-related concerns without reporting a new incident or hazard.
Thumbnail Image

Meta gắn nhãn nội dung do AI tạo ra trên Facebook và Instagram

2024-04-06
Báo Nhân Dân điện tử
Why's our monitor labelling this an incident or hazard?
The event involves AI systems in the sense that AI-generated content is being identified and labeled, but the article focuses on Meta's policy changes and content labeling strategy rather than any specific harm caused by AI or any incident involving AI malfunction or misuse. There is no direct or indirect harm reported, nor a credible imminent risk of harm described. Therefore, this is best classified as Complementary Information, providing context on governance and societal responses to AI content management.
Thumbnail Image

IA da Meta tem dificuldade em criar imagens de casais de raças diferentes

2024-04-04
Pplware
Why's our monitor labelling this an incident or hazard?
The AI system (Meta AI image generator) is explicitly involved in generating images that fail to meet the requested racial diversity, showing systematic bias. This is a use-related issue where the AI's outputs cause harm by misrepresenting racial diversity, which can be seen as harm to communities and a violation of rights (e.g., fair representation and non-discrimination). Although the harm is non-physical, it is significant and clearly articulated in the context of racial bias and misrepresentation. Therefore, this qualifies as an AI Incident rather than a hazard or complementary information.
Thumbnail Image

IA da Meta tem dificuldade em criar imagens de casais de origens diferentes

2024-04-04
Pplware
Why's our monitor labelling this an incident or hazard?
The Meta AI system is explicitly involved as the generative image AI. The issue arises from its use, where the system fails to accurately generate images as requested, showing bias towards same-origin representations and other subtle stereotypical biases. This misrepresentation can be considered a violation of rights related to fairness and non-discrimination, which falls under harm category (c) - violations of human rights or breach of obligations protecting fundamental rights. Since the harm is occurring through biased outputs affecting representation and inclusivity, this qualifies as an AI Incident rather than a mere hazard or complementary information. The article reports ongoing issues and examples of biased outputs, indicating realized harm rather than just potential risk.
Thumbnail Image

IA da Meta não consegue gerar casais de etnias diferentes

2024-04-05
Tecnologia
Why's our monitor labelling this an incident or hazard?
The event involves an AI system (Meta's generative AI) and its use (image generation). The system's failure to accurately generate images with ethnically diverse couples reflects a bias or limitation, which is a recognized issue in AI fairness and ethics. However, the article does not describe any realized harm such as injury, rights violations, or community harm. It reports on the AI's current performance issues and the need for further development. Therefore, this is not an AI Incident or AI Hazard but rather complementary information about the AI system's limitations and ongoing development challenges.
Thumbnail Image

IA da Meta é acusada de racismo por não conseguir criar casal inter-racial

2024-04-04
Terra
Why's our monitor labelling this an incident or hazard?
The AI system is explicitly mentioned as the image generation tool by Meta. The reported harm is the biased and stereotyped representation of interracial couples, which constitutes a violation of rights and harms communities by reinforcing racial stereotypes. This harm is realized and directly linked to the AI system's outputs. Therefore, this qualifies as an AI Incident under the framework, as the AI's use has directly led to a violation of rights and harm to communities through biased representation.
Thumbnail Image

IA da Meta não consegue gerar casais de etnias diferentes

2024-04-05
Canaltech
Why's our monitor labelling this an incident or hazard?
The AI system is explicitly mentioned as a generative AI by Meta. The issue arises from its use, where it fails to generate requested images accurately, showing bias in ethnic representation. This can be linked to harm to communities by reinforcing exclusion or misrepresentation, which is a recognized form of harm under the framework. Since the harm is occurring through the AI's outputs and use, this qualifies as an AI Incident rather than a hazard or complementary information.
Thumbnail Image

IA da Meta com problemas em gerar imagens de casais de diferentes etnias

2024-04-05
Notícias ao Minuto
Why's our monitor labelling this an incident or hazard?
The article highlights a limitation and bias in an AI image generation system, which is a known issue but does not describe any realized harm or incident. The system's biased outputs could plausibly lead to harm such as reinforcing stereotypes or discrimination if deployed widely without correction, but as the system is still in beta and no harm has been reported, this situation constitutes a potential risk rather than an actual incident. Therefore, it fits the definition of an AI Hazard rather than an AI Incident or Complementary Information.