Google Sues Chinese Cybercrime Group for Using Gemini AI in Large-Scale Scams

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Google has filed a lawsuit against a China-based cybercrime network, Outsider Enterprise, for weaponizing its Gemini AI to automate large-scale phishing and scam campaigns. The group used AI to create fake websites and messages, resulting in millions in financial losses for hundreds of thousands of victims, primarily in the US.[AI generated]

Why's our monitor labelling this an incident or hazard?

The involvement of AI is explicit, as the phishing group used AI tools to create phishing sites. The harm is realized, as phishing scams cause direct harm to individuals through fraud. The event describes the use and misuse of AI systems leading to violations of rights and harm to people, qualifying it as an AI Incident. The lawsuit and cooperation with law enforcement are responses but do not change the primary classification.[AI generated]
AI principles
Robustness & digital securityAccountability

Industries
Digital security

Affected stakeholders
Consumers

Harm types
Economic/Property

Severity
AI incident

AI system task:
Content generation

In other databases

Articles about this incident or hazard