Europol Warns of Criminal Misuse of ChatGPT for Fraud and Cybercrime

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Europol has detected repeated malicious use of the AI chatbot ChatGPT by criminals to facilitate fraud and other cybercrimes. The agency warns that ChatGPT's text generation capabilities and easily bypassed safeguards pose significant security challenges, as bad actors exploit the system to accelerate and enhance criminal activities.[AI generated]

Why's our monitor labelling this an incident or hazard?

ChatGPT is an AI system capable of generating detailed text outputs based on user inputs. Europol explicitly states that criminals have exploited ChatGPT for illegal activities, including fraud and other crimes, which constitute harm to communities and violations of law. The AI system's use in facilitating these crimes directly contributes to harm, meeting the criteria for an AI Incident. The warning is not merely about potential misuse but about observed malicious use causing harm.[AI generated]
AI principles
SafetyRobustness & digital securityAccountability

Industries
Digital security

Affected stakeholders
Consumers

Harm types
Economic/Property

AI system task:
Content generationInteraction support/chatbots


Articles about this incident or hazard