Malicious AI Chatbots Enable Cybercrime Surge on the Dark Web

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

AI tools like FraudGPT and WormGPT, designed without ethical safeguards, are being sold and used on the dark web to facilitate phishing, malware creation, and business email compromise attacks. These generative AI systems lower barriers for cybercriminals, directly enabling large-scale cyberattacks and financial harm to organizations and individuals.[AI generated]

Why's our monitor labelling this an incident or hazard?

The chatbots mentioned are AI systems based on generative AI technology (ChatGPT-3) that are being used maliciously to create realistic phishing content and malware. This use directly leads to harm to people by enabling fraud and cybercrime. Therefore, this constitutes an AI Incident as the AI system's use has directly led to harm through cybercriminal activities.[AI generated]
AI principles
AccountabilityRobustness & digital securitySafetyPrivacy & data governanceRespect of human rightsTransparency & explainability

Industries
Digital securityFinancial and insurance servicesIT infrastructure and hosting

Affected stakeholders
ConsumersBusiness

Harm types
Economic/PropertyReputationalHuman or fundamental rights

AI system task:
Content generationInteraction support/chatbots


Articles about this incident or hazard