Wild West AI Crime Exploits in Canada

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Canadian police warn that criminals are exploiting artificial intelligence by jailbreaking LLM safeguards for deepfake pornography, voice impersonation, and financial fraud. Cybercriminals are also building their own AI models and using dark web forums and Telegram channels, raising concerns about potential harm from misused AI technology.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly mentions AI systems (large language models, generative AI tools like ChatGPT and DALL-E) being used or misused to cause real harms such as financial fraud, sexual exploitation, and incitement to violence. The harms described fall under injury or harm to persons, violations of rights, and harm to communities. The criminal use of AI jailbreaking to remove safeguards and enable illegal activities is a direct cause of these harms. The article also references legal actions and law enforcement responses, confirming the harms are realized and significant. Thus, this qualifies as an AI Incident under the OECD framework.[AI generated]
AI principles
AccountabilityRobustness & digital securitySafetyPrivacy & data governanceRespect of human rightsHuman wellbeingTransparency & explainability

Industries
Digital securityMedia, social platforms, and marketingFinancial and insurance servicesGovernment, security, and defence

Affected stakeholders
ConsumersGeneral public

Harm types
Economic/PropertyReputationalHuman or fundamental rightsPsychologicalPublic interest

Severity
AI incident

AI system task:
Content generationInteraction support/chatbots


Articles about this incident or hazard