Microsoft Copilot AI Bug Exposes Confidential Emails by Bypassing Security Controls

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A bug in Microsoft 365 Copilot Chat allowed the AI assistant to access and summarize confidential emails, bypassing organizations' Data Loss Prevention (DLP) policies. This unauthorized processing of sensitive information led to privacy breaches. Microsoft acknowledged the issue, deployed a fix, and raised concerns about AI-related data security risks in workplace tools.[AI generated]

Why's our monitor labelling this an incident or hazard?

Microsoft 365 Copilot is an AI system integrated into productivity apps, and the bug caused unauthorized access to private emails, constituting a violation of privacy rights. This is a direct harm caused by the AI system's malfunction, fitting the definition of an AI Incident due to breach of obligations protecting fundamental rights.[AI generated]
AI principles
Privacy & data governanceRobustness & digital security

Industries
Digital securityIT infrastructure and hosting

Affected stakeholders
BusinessWorkers

Harm types
Human or fundamental rights

AI system task:
Content generationInteraction support/chatbots


Articles about this incident or hazard