Bremen Firefighter Investigated for Creating Extremist AI Images

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A Bremen firefighter is under investigation for allegedly using AI to generate and share racist and right-wing extremist images with colleagues. Police searched his home and workplace, confiscating evidence. The incident was reported by coworkers, leading to disciplinary and criminal proceedings and suspension from duty.[AI generated]

Why's our monitor labelling this an incident or hazard?

An AI system was explicitly used to create extremist and racist images, which constitutes a violation of human rights and harms communities. The AI's use in generating such content directly led to the incident, fulfilling the criteria for an AI Incident. The event involves realized harm through the creation and sharing of harmful AI-generated content, not just a potential risk or a response to harm. Therefore, it is classified as an AI Incident.[AI generated]
AI principles
SafetyRespect of human rights

Industries
Government, security, and defence

Affected stakeholders
General public

Harm types
Human or fundamental rightsPublic interestReputational

AI system task:
Content generation


Articles about this incident or hazard