Meta Withdraws AI Tool Over Instagram Photo Privacy Backlash

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Meta launched an AI feature allowing users to generate images using public Instagram photos without explicit consent, sparking significant privacy and consent concerns. Following intense public and industry backlash, including from Hollywood, Meta withdrew the tool within days, acknowledging it failed to meet privacy expectations.[AI generated]

Why's our monitor labelling this an incident or hazard?

The AI system (Muse AI) was used to generate content based on publicly available user images without explicit consent, which constitutes a violation of rights (image, likeness, and intellectual property). The event involves the use of an AI system, its deployment, and the resulting harm through unauthorized use of personal data. The harm is realized as it caused significant backlash and rights violations concerns. The withdrawal is a response but does not negate the incident. Therefore, this is an AI Incident due to direct harm caused by the AI system's use.[AI generated]
AI principles
Privacy & data governanceTransparency & explainability

Industries
Media, social platforms, and marketing

Affected stakeholders
Consumers

Harm types
Human or fundamental rights

Severity
AI incident

AI system task:
Content generation