Invisible 'Rules File Backdoor' Threatens AI Code Assistants

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Pillar Security researchers discovered a vulnerability dubbed the 'Rules File Backdoor' in GitHub Copilot and Cursor. The flaw allows attackers to inject malicious code via compromised rule files, bypassing conventional checks and posing significant supply chain risks to developers and the broader software ecosystem.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event explicitly involves AI systems (GitHub Copilot and Cursor) used in code generation. The malicious manipulation of rule files leads to the AI generating compromised code that can exfiltrate sensitive information and introduce security vulnerabilities, which constitutes harm to property and potentially to communities relying on secure software. Since the attack has been demonstrated and involves actual exploitation of AI systems causing or enabling harm, this qualifies as an AI Incident under the framework. The harm is direct and realized through the AI's outputs being weaponized to compromise software security and data confidentiality.[AI generated]
AI principles
Robustness & digital securityTransparency & explainabilitySafetyAccountability

Industries
IT infrastructure and hostingDigital securityReal estate

Affected stakeholders
WorkersBusiness

Harm types
Economic/PropertyReputationalPublic interest

Business function:
Research and developmentICT management and information security

AI system task:
Content generationInteraction support/chatbots


Articles about this incident or hazard