Apple Deploys AI Scanning for Harmful Content in Public iCloud Links

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Apple is implementing AI-powered scanning of photos and files shared via public iCloud links to detect harmful content. Items shared using "Anyone with the Link" lose end-to-end encryption, and Apple may remove content or disable accounts if violations are found, raising privacy concerns.[AI generated]

Why's our monitor labelling this an incident or hazard?

An AI system is reasonably inferred because content scanning for harmful material at scale typically involves AI or automated detection algorithms. The event stems from the use of such AI systems to moderate user content. No direct or indirect harm has been reported yet, so it is not an AI Incident. The potential for harm exists due to vague content definitions and enforcement powers, making it plausible that the AI system's use could lead to violations of rights or other harms. The article focuses on the policy implementation and potential consequences rather than a response to a past incident, so it is not Complementary Information. Hence, the event is best classified as an AI Hazard.[AI generated]
AI principles
Privacy & data governance

Industries
IT infrastructure and hostingDigital security

Affected stakeholders
Consumers

Harm types
Human or fundamental rights

Business function:
Monitoring and quality control

AI system task:
Recognition/object detection


Articles about this incident or hazard