AI-Generated Videos Spread Hate and Violence Online, Sparking Outrage

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

AI-generated videos depicting violence and hate against LGBTQ+, Jewish, Muslim, and other minority groups have proliferated on social media, garnering significant engagement and applause. The spread of such content is causing real harm to vulnerable communities and raising concerns about the lack of effective safety regulations.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves the use of AI systems (generative AI for video creation) that have directly led to harm by spreading hateful and violent content targeting vulnerable minority groups, which constitutes harm to communities and violations of rights. The harm is realized and ongoing, as evidenced by the widespread dissemination and the concerns raised by advocacy groups and experts. Therefore, this qualifies as an AI Incident. The article also discusses regulatory and governance responses, but the primary focus is on the harm caused by the AI-generated content itself, not just the responses, so it is not merely Complementary Information.[AI generated]
AI principles
AccountabilityFairnessRespect of human rightsSafety

Industries
Media, social platforms, and marketing

Affected stakeholders
General public

Harm types
PsychologicalHuman or fundamental rightsPublic interest

Severity
AI incident

AI system task:
Content generation


Articles about this incident or hazard

Thumbnail Image

Concerns grow as AI-generated videos spread hate, racism online: 'No safety rules' | Globalnews.ca

2025-08-10
Global News
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems (generative AI for video creation) that have directly led to harm by spreading hateful and violent content targeting vulnerable minority groups, which constitutes harm to communities and violations of rights. The harm is realized and ongoing, as evidenced by the widespread dissemination and the concerns raised by advocacy groups and experts. Therefore, this qualifies as an AI Incident. The article also discusses regulatory and governance responses, but the primary focus is on the harm caused by the AI-generated content itself, not just the responses, so it is not merely Complementary Information.
Thumbnail Image

'No safety rules': Concerns grow as AI-generated videos spread hate online

2025-08-10
Times Colonist
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems (generative AI video tools) to create and spread hateful and violent content online, which has directly led to harm to communities and violations of rights. The harm is materialized as the videos are widely circulated and celebrated by some, increasing the risk of real-world violence. This fits the definition of an AI Incident because the AI system's use has directly led to significant harm. The article also highlights the insufficiency of current laws and the need for regulatory responses, but the primary focus is on the realized harm caused by AI-generated hateful content, not just potential future harm or responses, so it is not Complementary Information or an AI Hazard.
Thumbnail Image

'No safety rules': Concerns grow as AI-generated videos spread hate online

2025-08-10
Lethbridge News Now
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems (generative AI tools) to create and disseminate hateful and violent content that is actively causing harm to vulnerable communities, including LGBTQ+ individuals and religious minorities. This constitutes a violation of human rights and harm to communities, fulfilling the criteria for an AI Incident. The article reports on realized harm rather than just potential harm, and the AI systems' role in generating and amplifying hateful content is pivotal. Therefore, this event is best classified as an AI Incident.
Thumbnail Image

Concerns Grow As Ai-generated Videos Spread Hate, Racism Online: 'no Safety Rules' - Beritaja

2025-08-10
Beritaja.com
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems (generative AI) to create and spread hateful and racist content online, which directly harms communities by promoting discrimination and hate speech. This constitutes a violation of rights and harm to communities as defined in the framework. The harm is realized and ongoing, not merely potential, making this an AI Incident. The article also mentions regulatory and governance responses, but the primary focus is on the harm caused by the AI-generated content itself.
Thumbnail Image

'No safety rules': Concerns grow as AI-generated videos spread hate online

2025-08-11
Sudbury.com
Why's our monitor labelling this an incident or hazard?
The event involves AI systems (generative AI video tools) whose use has directly led to harm to communities by spreading hateful and violent content online. This constitutes a violation of rights and harm to communities as defined in the framework. The harm is realized and ongoing, not merely potential, making this an AI Incident. The article focuses on the impact of these AI-generated hateful videos and the societal response, rather than just describing the technology or policy discussions alone. Therefore, the classification as an AI Incident is appropriate.
Thumbnail Image

'No safety rules': Concerns grow as AI-generated videos spread hate online

2025-08-10
thepeterboroughexaminer.com
Why's our monitor labelling this an incident or hazard?
The event involves AI systems generating hateful and violent video content that is actively spreading on social media, directly causing harm to communities by promoting violence and hate speech. This meets the definition of an AI Incident because the AI system's use has directly led to harm to communities (harm category d). The article provides evidence of realized harm through the spread and impact of these videos, not just potential harm. Therefore, the classification is AI Incident.
Thumbnail Image

'No safety rules': Concerns grow as AI-generated videos spread hate online

2025-08-10
The Lethbridge Herald - News and Sports from around Lethbridge
Why's our monitor labelling this an incident or hazard?
The event involves AI systems (generative AI creating video content) whose use has directly led to harm by spreading hateful and violent content online, which in turn increases the likelihood of real-world violence and discrimination against vulnerable groups. This fits the definition of an AI Incident because the AI-generated content is actively causing harm to communities and violating rights. The article's focus is on the harms caused by the AI-generated hateful videos and the societal impact, not merely on regulatory or technological responses, so it is not Complementary Information. Therefore, the classification is AI Incident.