Microsoft's AI-Powered Recall Feature Still Exposes Sensitive User Data Despite Security Overhaul

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Microsoft's AI-powered Recall feature for Windows continues to face criticism after cybersecurity researcher Alexander Hagenah demonstrated that sensitive user data can still be extracted using his TotalRecall Reloaded tool. Despite Microsoft's security redesign, flaws in Recall's data delivery process allow unauthorized access, raising ongoing privacy and data protection concerns.[AI generated]

Why's our monitor labelling this an incident or hazard?

The Windows Recall tool is an AI-enabled system that captures user activity snapshots, involving AI system use. The demonstrated ability of a third-party tool to exploit authentication prompts and extract sensitive data indicates a malfunction or misuse scenario that could lead to harm to users' privacy and security, a violation of rights. Although Microsoft denies the flaw, the expert's findings and the potential for data theft mean the AI system's use has directly or indirectly led to a significant harm risk. This fits the definition of an AI Incident rather than a mere hazard or complementary information, as the harm is plausible and linked to the AI system's operation and security design flaws.[AI generated]
AI principles
Privacy & data governanceRobustness & digital security

Industries
IT infrastructure and hostingDigital security

Affected stakeholders
Consumers

Harm types
Human or fundamental rights

AI system task:
Organisation/recommenders


Articles about this incident or hazard