Chinese Officials Use ChatGPT for Cross-Border Intimidation and Disinformation Campaigns

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

OpenAI revealed that Chinese officials used ChatGPT to document and facilitate large-scale cross-border intimidation and disinformation campaigns, including impersonating U.S. officials to threaten dissidents, fabricating false death notices, and attempting to smear Japan's Prime Minister. These AI-enabled actions resulted in real-world harm, violating human rights and spreading misinformation globally.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event explicitly involves the use of an AI system (ChatGPT) in the misuse context, leading to direct harm such as financial fraud (dating scams defrauding victims) and violations of rights (impersonation of law firms and officials). The harms are realized and ongoing, meeting the criteria for an AI Incident. The report details actual misuse and resulting harm, not just potential or hypothetical risks, so it is not an AI Hazard or Complementary Information. Therefore, the classification is AI Incident.[AI generated]
AI principles
Respect of human rightsAccountability

Industries
Government, security, and defenceMedia, social platforms, and marketing

Affected stakeholders
General publicGovernment

Harm types
Human or fundamental rightsPsychologicalPublic interest

AI system task:
Content generation


Articles about this incident or hazard