AI-Driven Phishing Attacks Target ChatGPT and Exploit Generative AI

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Cybercriminals are increasingly using generative AI tools to create sophisticated phishing campaigns, with ChatGPT now among the top impersonated brands. These AI-enabled attacks are faster, more scalable, and harder to detect, leading to credential theft and financial harm for individuals and organizations globally.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves the use and misuse of AI systems: ChatGPT as the impersonated AI platform and generative AI tools used by attackers to enhance phishing attacks. The phishing campaigns have already caused harm by stealing credentials and potentially exposing sensitive information, fulfilling the criteria for an AI Incident. The article details actual phishing attacks exploiting AI platforms, not just potential or future risks, and thus it is not an AI Hazard or Complementary Information. It is not Beneficial Use since the AI is the source of harm, nor is it Unrelated as AI systems are central to the event.[AI generated]
AI principles
Privacy & data governanceRobustness & digital security

Industries
Digital security

Affected stakeholders
ConsumersBusiness

Harm types
Economic/PropertyHuman or fundamental rights

AI system task:
Content generation


Articles about this incident or hazard