Anthropic Accuses Alibaba of Large-Scale AI Model Distillation Attack

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

US AI company Anthropic accused Chinese tech giant Alibaba of conducting a large-scale 'distillation attack' by using 25,000 fraudulent accounts to extract outputs from Anthropic's Claude model for training Alibaba's own AI models. The alleged unauthorized data extraction violated intellectual property rights and was reported to US Senate committees.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event explicitly involves AI systems (Claude model and Alibaba's alleged distillation efforts). The unauthorized extraction and use of AI model capabilities through fraudulent interactions directly violate intellectual property rights, which is a recognized harm under the AI Incident definition. The scale of the operation and the involvement of fraudulent accounts indicate deliberate misuse leading to harm. Hence, it meets the criteria for an AI Incident rather than a hazard or complementary information.[AI generated]
AI principles
AccountabilityRobustness & digital security

Industries
Digital security

Affected stakeholders
Business

Harm types
Economic/PropertyReputational

Business function:
Other

AI system task:
Content generation


Articles about this incident or hazard