Microsoft's Forced Installation of AI-Powered OneDrive Photos Raises Privacy Concerns

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Microsoft silently installed the OneDrive Photos app on Windows 11 devices without user consent. The app uses AI-driven facial recognition to scan and group local photos, processing biometric data. This unauthorized deployment and data processing have raised significant privacy and rights violation concerns, especially regarding biometric information.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves an AI system (OneDrive Photos) that uses AI for facial recognition and AI cloud search. The system was automatically installed without explicit user consent, scanning local photos and processing biometric data, which implicates privacy and fundamental rights violations. The harm is realized as users' biometric data and personal photos are scanned and processed without clear prior consent, constituting a breach of privacy rights. This meets the criteria for an AI Incident under violations of human rights or breach of obligations protecting fundamental rights. The article also discusses user options to disable or uninstall the app, but the core issue of unauthorized AI-driven biometric data processing remains. Hence, the classification is AI Incident.[AI generated]
AI principles
Privacy & data governanceRespect of human rights

Industries
IT infrastructure and hosting

Affected stakeholders
Consumers

Harm types
Human or fundamental rights

AI system task:
Recognition/object detection


Articles about this incident or hazard