DeepSeek AI Faces Outages, Content Safety Failures, and Harmful Outputs in China

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

DeepSeek, a Chinese AI platform, has faced repeated large-scale outages disrupting user tasks, and its automated moderation has led to user bans. Despite content restrictions, users bypassed filters to generate explicit and fabricated content, including pornography and fake scientific data, raising concerns about harm to minors and misinformation.[AI generated]

Why's our monitor labelling this an incident or hazard?

DeepSeek is an AI system generating text content. The report shows that despite content restrictions, users can bypass filters to generate explicit (pornographic) content, which is a violation of content safety and can harm communities. Additionally, the AI generates fabricated scientific data and references, which can mislead users and propagate misinformation, causing harm to public understanding and trust. These harms are directly linked to the AI system's outputs and its failure to adequately filter or verify content, fulfilling the criteria for an AI Incident involving harm to communities and violation of content safety obligations.[AI generated]
AI principles
SafetyRobustness & digital security
Industries
Media, social platforms, and marketingConsumer services
Affected stakeholders
ChildrenGeneral public
Harm types
PsychologicalPublic interest
Business function:
Monitoring and quality control
AI system task:
Content generation

Articles about this incident or hazard