Microsoft’s Non-Removable AI Recall Stirs Privacy Concerns

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Microsoft’s Windows 11 now includes a non-removable AI-driven Recall feature that captures screenshots and scans all media via Intelligent Media Search. Users and regulators warn it indexes sensitive data unencrypted, poses privacy, security, and performance risks, and will be a permanent OS component.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves an AI system (an AI-powered content search tool) in development and testing. The article discusses plausible future harms related to privacy breaches and security vulnerabilities if the system is compromised. Since no actual harm has occurred yet, and the focus is on potential risks and user concerns, this fits the definition of an AI Hazard. It is not Complementary Information because the article is not primarily about responses or governance but about the emergence of a new AI feature with potential risks. It is not an AI Incident because no realized harm is described.[AI generated]
AI principles
Privacy & data governanceRobustness & digital securityTransparency & explainabilityAccountabilityRespect of human rightsDemocracy & human autonomySafety

Industries
Consumer productsIT infrastructure and hostingDigital securityGovernment, security, and defence

Affected stakeholders
Consumers

Harm types
Human or fundamental rightsEconomic/PropertyReputational

Severity
AI hazard

AI system task:
Recognition/object detectionOrganisation/recommenders


Articles about this incident or hazard

Thumbnail Image

Windows 11: Recall wird sich deinstallieren lassen

2024-09-02
computerbild.de
Why's our monitor labelling this an incident or hazard?
The event involves an AI system (Windows Recall) and mentions a hacking incident targeting it, which implies a security breach related to the AI system's data handling. While this suggests potential harm, the article does not confirm any direct or indirect harm resulting from the AI system's use or malfunction. The concerns about privacy and security, along with regulatory scrutiny, indicate plausible risks but no confirmed incident of harm. Therefore, this qualifies as Complementary Information, as it provides context and updates about the AI system's ecosystem, responses, and potential issues without reporting a new AI Incident or Hazard.
Thumbnail Image

Windows Recall: Das kontroverse Feature lässt sich nicht deinstallieren, bestätigt Microsoft

2024-09-03
GameStar
Why's our monitor labelling this an incident or hazard?
Recall is an AI system as it uses AI to analyze screenshots. The event involves the development and deployment of this AI feature. However, there is no evidence of realized harm such as privacy violations or other direct harms occurring yet. The controversy and criticism reflect concerns about potential harms, but these are not confirmed incidents. The article focuses on the feature's rollout, removal of the removal option, and community reaction, which fits the definition of Complementary Information rather than an Incident or Hazard.
Thumbnail Image

Recall 2.0? Microsoft plant weitere KI-Funktion, die alles mitliest

2024-09-04
PC-WELT
Why's our monitor labelling this an incident or hazard?
The event involves an AI system (an AI-powered content search tool) in development and testing. The article discusses plausible future harms related to privacy breaches and security vulnerabilities if the system is compromised. Since no actual harm has occurred yet, and the focus is on potential risks and user concerns, this fits the definition of an AI Hazard. It is not Complementary Information because the article is not primarily about responses or governance but about the emergence of a new AI feature with potential risks. It is not an AI Incident because no realized harm is described.
Thumbnail Image

Windows 11: Umstrittenes "Spionage"-Feature nicht entfernbar

2024-09-03
PC Games Hardware
Why's our monitor labelling this an incident or hazard?
The Recall feature uses AI-based real-time screen analysis and screenshot capturing, qualifying it as an AI system. The article focuses on the controversy around privacy and the inability to uninstall the feature, which could plausibly lead to violations of user privacy rights. Since no actual harm is reported as having occurred yet, but the risk is credible and ongoing, this fits the definition of an AI Hazard rather than an Incident. The article also discusses potential regulatory pressure in the EU, which is complementary context but does not change the classification.
Thumbnail Image

AI-Überwachung in Windows 11 kann nicht entfernt werden: Recall wird im Oktober fester Windows-Bestandteil

2024-09-02
Notebookcheck
Why's our monitor labelling this an incident or hazard?
Recall is an AI system integrated into Windows 11 that uses AI to index and search screenshots of user activity. Its deployment and inability to be removed, combined with the storage of sensitive data unencrypted, directly implicate user privacy and security risks. These risks constitute harm to users' rights and privacy, fulfilling the criteria for an AI Incident. The article reports on the actual deployment and the associated risks, not just potential future harm or general information, so it qualifies as an AI Incident.
Thumbnail Image

Plant Microsoft eine weitere Recall-Funktion?

2024-09-05
Computerwoche
Why's our monitor labelling this an incident or hazard?
The feature involves AI as it scans and retrieves various media types using intelligent search capabilities. However, the article only discusses potential privacy and security concerns without evidence of realized harm or incidents. Therefore, it represents a plausible future risk (AI Hazard) rather than an actual incident. Since the article focuses on the emergence of the feature and related concerns without reporting harm or responses, it fits best as an AI Hazard due to plausible future privacy and security risks.
Thumbnail Image

Esta controvertida función de Microsoft no se puede desinstalar - Digital Trends Español

2024-09-03
Digital Trends Español
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions an AI system (Recall) integrated into Windows 11, which is related to AI capabilities requiring NPUs. The inability to uninstall the feature and the associated security concerns indicate a plausible risk of harm, but no direct or indirect harm has occurred yet. Therefore, this situation represents a potential risk or hazard rather than an incident. The article focuses on the feature's status, security concerns, and Microsoft's response, fitting the definition of an AI Hazard rather than an Incident or Complementary Information.
Thumbnail Image

Microsoft añadió por error una opción para desinstalar la polémica característica Recall de Windows 11. Por error

2024-09-03
Xataka
Why's our monitor labelling this an incident or hazard?
Recall is an AI-related feature in Windows 11 with privacy and security concerns, but the article does not report any direct or indirect harm caused by its use or malfunction. The mistaken appearance of an uninstall option is a bug, not a harmful incident. The feature is not yet broadly released, and Microsoft is addressing the issue. Thus, this situation constitutes an AI Hazard because it could plausibly lead to harm if the security issues are not resolved, but no harm has occurred yet.
Thumbnail Image

Cuidado si has desinstalado la función Recall de Windows: Microsoft dice que es un fallo del sistema

2024-09-03
20 minutos
Why's our monitor labelling this an incident or hazard?
Recall is an AI system feature that captures and analyzes user activity. The article mentions potential privacy risks and a system bug allowing unintentional uninstallation, but no actual harm or violation has occurred yet. Microsoft's acknowledgment and planned fix indicate ongoing management of the issue. Since no direct or indirect harm has materialized, and the article mainly provides updates and context about the AI system and its governance, it fits the definition of Complementary Information rather than an Incident or Hazard.
Thumbnail Image

La polémica función de IA, Recall, no se podrá desinstalar de Windows 11

2024-09-03
SoftZone
Why's our monitor labelling this an incident or hazard?
The article centers on the controversy and user concerns about the AI Recall feature's privacy and security implications, but it does not document any actual harm or incident caused by the AI system. The mention of the feature being permanently installed despite user opposition is a governance and deployment issue rather than a direct or indirect harm event. There is no indication that the AI system malfunctioned or was misused to cause harm, nor that harm is imminent or plausible beyond general concerns. Thus, it fits the definition of Complementary Information, providing updates and context about AI deployment and societal response rather than reporting an AI Incident or Hazard.