Man Uses AI to Fake Suicide Photo, Triggers Emergency Response in Qinghai

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

In Qinghai, China, a man used AI to generate a fake photo of himself in the Yellow River, pretending to attempt suicide to frighten his wife. The fabricated image led police to launch a full-scale emergency search, wasting public resources and disrupting social order. The man was detained for his actions.[AI generated]

Why's our monitor labelling this an incident or hazard?

An AI system was explicitly used to generate a false image, which directly caused harm by wasting emergency response resources and disrupting public order. Although no physical injury occurred, the misuse of AI to fabricate a false emergency constitutes harm under the category of disruption of management and operation of critical infrastructure (emergency services) and harm to communities (public order). Therefore, this qualifies as an AI Incident.[AI generated]
AI principles
SafetyTransparency & explainability

Industries
Government, security, and defence

Affected stakeholders
General publicGovernment

Harm types
Economic/PropertyPsychologicalPublic interest

AI system task:
Content generation


Articles about this incident or hazard