AI Systems Used for Large-Scale Production and Distribution of Obscene Content Lead to Criminal Convictions in China

The event explicitly involves the use of AI software to create pornographic materials, which is illegal and harmful. The defendant sold AI-generated pornography tutorials and software, directly causing harm by enabling the production and dissemination of prohibited content. This constitutes a violation of law and harm to social norms and communities. The AI system's use is central to the incident, fulfilling the criteria for an AI Incident as the AI system's use directly led to harm and legal violations.

The event explicitly involves an AI system (AlienChat) that generates content through AI chatbots. The developers intentionally modified the AI prompts to bypass ethical safeguards and produce obscene content, which was then used by many users, causing large-scale production of illegal pornographic material. This led to criminal convictions, demonstrating direct harm to society and violation of laws protecting public order and morality. The AI system's development and use directly caused this harm. The article also discusses governance and technical responses, but the primary focus is on the incident of harm caused by the AI system's misuse. Hence, it qualifies as an AI Incident.

The case involves an AI system (AI drawing software) explicitly used to create and distribute illegal pornographic content, which is a violation of laws protecting public morality and potentially harms communities. The AI system's use directly led to criminal activity and legal consequences, fulfilling the criteria for an AI Incident. The event is not merely a potential risk or a complementary update but a concrete case of harm caused by AI misuse. The court's detailed findings and sentencing further confirm the direct link between the AI system's use and the harm caused.

The case explicitly involves AI systems used to generate pornographic content and distribute related tools and tutorials, which directly led to illegal profits and the spread of obscene materials. The AI system's use in this criminal activity caused harm by facilitating the production and dissemination of illegal content, violating legal and societal norms. The court's judgment and the description of the AI's role in lowering the barrier to creating such content confirm the AI system's pivotal role in the incident. Hence, this event meets the criteria for an AI Incident as the AI system's use directly led to harm and legal violations.

The event explicitly involves AI systems used to produce pornographic materials, which is illegal content. The defendant's use of AI software and tutorials to facilitate the creation and dissemination of such content constitutes a direct link between AI use and harm, specifically violations of applicable laws and harm to social environment. The illegal activity and resulting legal consequences confirm that harm has occurred due to the AI system's use. Therefore, this qualifies as an AI Incident under the framework, as the AI system's use directly led to violations of law and social harm.

The event involves an AI system (AlienChat) that generates sexually explicit content through AI chat interactions. The developers intentionally modified the AI prompts to bypass ethical constraints, enabling large-scale production of illegal obscene content. This caused direct harm by violating laws against obscene material production and disrupting social order. The criminal convictions confirm realized harm. The article also discusses governance and legal responses, but the core event is the AI system's use causing legal and social harm, fitting the definition of an AI Incident.