FraudGPT Enables Cybercriminals to Launch AI-Powered Attacks

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

FraudGPT, an AI tool sold on the dark web, is designed to generate malicious content for cyberattacks, such as phishing and malware creation. Unlike ChatGPT, it lacks safety controls, enabling cybercriminals to exploit its capabilities for fraud and data theft, posing significant risks to individuals and organizations.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article centers on the potential risks and pitfalls of using ChatGPT for enterprise purposes, particularly regarding data leakage and intellectual property violations. These risks are plausible and credible but have not yet materialized as actual incidents causing harm. Therefore, the event qualifies as an AI Hazard because it describes circumstances where the use of an AI system (ChatGPT) could plausibly lead to harm, but no direct or indirect harm has been reported or confirmed in the article. It is not Complementary Information because the focus is not on responses or updates to a past incident, nor is it Unrelated since it clearly involves an AI system and its potential risks.[AI generated]
AI principles
AccountabilitySafetyRobustness & digital securityPrivacy & data governanceRespect of human rightsTransparency & explainabilityHuman wellbeing

Industries
Digital securityIT infrastructure and hostingFinancial and insurance servicesGovernment, security, and defence

Affected stakeholders
ConsumersBusiness

Harm types
Economic/PropertyReputationalHuman or fundamental rights

Business function:
Other

AI system task:
Content generation


Articles about this incident or hazard