AI Voice Robots Used in Massive Phone Scam, 18 Arrested in China

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A criminal gang in China used AI voice robots to make 17 million scam calls, screening 800,000 potential victims and enabling large-scale financial fraud. The AI system's realistic interactions deceived victims, leading to losses totaling nearly 1.8 billion yuan. Police arrested 18 suspects involved in the operation.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly describes the use of AI voice robots that automatically dialed 17 million scam calls and screened 800,000 potential victims, leading to nearly 1.8 billion yuan in fraudulent commissions. The AI system's development and use directly contributed to the harm by enabling the scam's scale and sophistication, including realistic voice interactions that victims could not distinguish from humans. This constitutes an AI Incident because the AI system's use directly caused significant financial harm to many individuals, fulfilling the criteria of harm to property and communities. Therefore, the event is classified as an AI Incident.[AI generated]
AI principles
AccountabilitySafetyTransparency & explainabilityPrivacy & data governanceRobustness & digital securityRespect of human rightsDemocracy & human autonomyHuman wellbeing

Industries
Financial and insurance servicesDigital security

Affected stakeholders
Consumers

Harm types
Economic/PropertyPsychologicalHuman or fundamental rights

Business function:
Marketing and advertisementSales

AI system task:
Interaction support/chatbotsContent generationForecasting/prediction


Articles about this incident or hazard