Meta's AI Uses Instagram Photos Without Explicit Consent, Raising Privacy Concerns

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Meta's new AI models, Muse Image and Muse Video, use public Instagram photos to generate images without explicit user consent. Users are automatically opted in, and are not notified when their images are used. This has led to privacy violations, as withdrawal of consent does not remove AI-generated images.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves an AI system (Meta's Muse Image) that uses user photos from public Instagram accounts to generate images. The automatic opt-in without explicit user consent and lack of notification about usage constitutes a violation of users' rights and privacy, which is a breach of obligations under applicable law protecting fundamental rights. This meets the criteria for an AI Incident under the definition of violations of human rights or breach of legal obligations. Although no direct physical harm is reported, the infringement on privacy and consent is a significant harm. Hence, the event is classified as an AI Incident.[AI generated]
AI principles
Privacy & data governanceRespect of human rights

Industries
Media, social platforms, and marketing

Affected stakeholders
Consumers

Harm types
Human or fundamental rights

Severity
AI incident

Business function:
Research and development

AI system task:
Content generation


Articles about this incident or hazard