Meta AI Prompts Raise Privacy Concerns After Profiling Children from Social Media Posts

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

US content creator Kalie Robins posted a video of her daughter on Instagram, after which Meta's AI generated prompts that revealed personal information about her children, including deleted photos and sensitive data. This incident highlights significant privacy violations and risks to child safety caused by AI-driven profiling on Meta platforms.[AI generated]

Why's our monitor labelling this an incident or hazard?

An AI system (Meta AI) is explicitly involved in generating suggested questions that aggregate personal data from multiple sources, including deleted content, about minors. This aggregation and exposure of sensitive information constitutes a violation of privacy rights, which falls under violations of human rights or breach of obligations protecting fundamental rights. The harm is realized as the user experiences distress and privacy invasion. Therefore, this event qualifies as an AI Incident due to the direct involvement of an AI system causing harm related to privacy and rights violations.[AI generated]
AI principles
Privacy & data governanceRespect of human rights

Industries
Media, social platforms, and marketing

Affected stakeholders
Children

Harm types
Human or fundamental rightsPsychological

Business function:
Marketing and advertisement

AI system task:
Content generation


Articles about this incident or hazard