AI-Driven Malware Causes Real-World Harm and Evades Detection

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Researchers have discovered multiple malware samples, including CLOSEDQUORUM and PROMPTFLUX, that use AI models for autonomous control, adaptive behavior, and self-rewriting to evade detection. These AI-powered malware have been used in live attacks, resulting in data and credential theft, highlighting a new wave of cyber threats.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly details AI systems integrated into malware that have been used in live attacks causing harm, such as data exfiltration and device manipulation. The harms include violations of privacy, potential financial losses, and disruption to users' devices. The AI involvement is central to the malware's ability to evade detection and adapt dynamically, which directly contributes to the harm. Since harm has already occurred and the AI system's role is pivotal, this qualifies as an AI Incident rather than a hazard or complementary information.[AI generated]
AI principles
Privacy & data governanceRobustness & digital security

Industries
Digital security

Affected stakeholders
Business

Harm types
Economic/PropertyHuman or fundamental rights

AI system task:
Goal-driven organisationEvent/anomaly detection


Articles about this incident or hazard